-- Logs begin at Mon 2022-05-23 15:46:28 UTC, end at Mon 2022-05-23 17:09:32 UTC. -- May 23 16:36:07.786973 dv-cinder-839257-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 23 16:36:07.794320 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 23 16:36:07.798506 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 16:36:07 2022] *** May 23 16:36:07.798506 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 16:36:07.798506 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 16:36:07.798506 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: nodename: dv-cinder-839257-3-iscsi May 23 16:36:07.798506 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: machine: x86_64 May 23 16:36:07.798506 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: clock source: unix May 23 16:36:07.798506 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: pcre jit disabled May 23 16:36:07.798506 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: detected number of CPU cores: 4 May 23 16:36:07.798506 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: current working directory: / May 23 16:36:07.798506 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: detected binary path: /usr/bin/uwsgi-core May 23 16:36:07.798506 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: your processes number limit is 47680 May 23 16:36:07.798506 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: your memory page size is 4096 bytes May 23 16:36:07.798506 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: detected max file descriptor number: 2048 May 23 16:36:07.798506 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: lock engine: pthread robust mutexes May 23 16:36:07.798506 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: thunder lock: enabled May 23 16:36:07.798506 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 23 16:36:07.798506 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 16:36:07.843225 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: Python main interpreter initialized at 0x55654b7e89c0 May 23 16:36:07.843225 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: python threads support enabled May 23 16:36:07.843225 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: your server socket listen backlog is limited to 100 connections May 23 16:36:07.843225 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: your mercy for graceful operations on workers is 90 seconds May 23 16:36:07.843596 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: mapped 403077 bytes (393 KB) for 2 cores May 23 16:36:07.843673 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: *** Operational MODE: preforking *** May 23 16:36:07.843901 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: *** uWSGI is running in multiple interpreter mode *** May 23 16:36:07.843901 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: spawned uWSGI master process (pid: 110284) May 23 16:36:07.844098 dv-cinder-839257-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 23 16:36:07.844924 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: spawned uWSGI worker 1 (pid: 110285, cores: 1) May 23 16:36:07.845032 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: spawned uWSGI worker 2 (pid: 110286, cores: 1) May 23 16:36:07.847037 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 16:36:09.016546 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 16:36:09.025084 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 16:36:09.741837 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 16:36:09.741837 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: from cryptography.utils import int_from_bytes May 23 16:36:09.742162 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 16:36:09.742162 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: from cryptography.utils import int_from_bytes May 23 16:36:09.744520 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 16:36:09.744520 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: from cryptography.utils import int_from_bytes May 23 16:36:09.744866 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 16:36:09.744866 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: from cryptography.utils import int_from_bytes May 23 16:36:12.334975 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 16:36:12.335622 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 16:36:12.335725 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 16:36:12.336083 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 16:36:12.336360 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 16:36:12.336749 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.337075 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.337404 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.337723 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.338054 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.338362 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.338682 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.339002 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.339330 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.339593 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.339685 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 16:36:12.340040 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 16:36:12.340131 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.340224 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839257-3-iscsi {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.340415 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 16:36:12.340550 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.340771 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 16:36:12.340864 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.341022 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 16:36:12.341158 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.341401 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.341499 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.342260 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.342365 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.342601 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.342751 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.342910 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.343069 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.343395 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.343492 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.343703 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.343828 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.344018 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.344139 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.344378 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.344508 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.344694 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.344874 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.345075 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.345269 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.345562 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.345750 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.345946 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839257-3-iscsi {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.346137 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.346330 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.346525 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.346726 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.346914 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.347111 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.347297 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.347505 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.347699 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839257-3-iscsi {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.347885 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.348077 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.348267 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.348267 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.348643 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.348643 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.348992 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.349217 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.349417 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.349600 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.349762 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.349889 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.350059 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.350197 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.350386 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.350517 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.350659 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.350932 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.351095 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.351229 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.351367 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.351519 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.351660 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.351785 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.351918 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.352049 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.352174 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.352353 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.352493 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839257-3-iscsi {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.352626 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.352752 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.352883 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.353009 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.353142 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.353284 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.353428 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.353428 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.353698 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.353830 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.353967 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.354110 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.354247 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.354392 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.354527 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.354659 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.354820 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.354993 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.355163 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.355305 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.355514 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.355653 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.355793 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.355927 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.356053 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.356190 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.356356 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.356511 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.356648 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.356782 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.356915 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.357039 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.357164 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.357308 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.358052 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.358191 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.358340 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.358477 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.358613 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.358755 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.358894 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.359023 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.359153 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.359284 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.359417 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.359561 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.359696 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.359829 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.359953 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.359953 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.360206 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.360421 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.360560 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.360696 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.360836 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.361291 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.361428 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.361560 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.361692 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.361822 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.361958 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.362100 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.362231 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.362357 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.362488 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.362612 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.362743 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.362879 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.363005 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.363137 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.363262 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.363385 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.363514 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.363647 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.363779 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.363903 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.364026 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.364149 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.364285 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.364446 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.364572 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.364705 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.364830 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.364960 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.365097 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.365234 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.365359 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.365483 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.365613 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.365738 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.365870 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.365995 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.366118 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.366252 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.366383 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.366508 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.366647 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.366801 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.366930 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.367101 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.367230 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.367403 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.367545 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.367703 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.367842 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.368015 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.368150 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.368351 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.368493 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.368652 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.368786 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.368910 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.369040 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.369173 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.369298 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.369464 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.369592 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.369775 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.369911 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.370075 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.370204 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.370375 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.370516 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.370675 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.370804 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.371005 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.371141 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.371281 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.371479 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.371608 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.371739 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.371876 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.372008 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.372132 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.372262 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.372443 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.372568 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.372705 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.372865 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.372994 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.373297 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.373442 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.373623 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.373751 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.373875 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.373999 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.374193 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.374320 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.374495 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.374623 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.374796 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.374924 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.375096 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.375230 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.375396 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.375524 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.375700 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.375835 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.375998 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.376124 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.376313 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.376455 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.376629 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.376765 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.376929 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.377058 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.377229 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.377358 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.377531 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.377663 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.377828 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.377960 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.378128 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.378265 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.378440 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.378568 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.378733 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.378871 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.379031 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.379160 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.379340 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.379468 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.379640 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.379788 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.379924 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.380056 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.380223 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.380406 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.380548 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.380689 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.380837 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.380977 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.381135 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.381263 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.381432 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.381658 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.381787 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.381911 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.382042 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.382174 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.382311 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.382494 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.382621 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.382822 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.382949 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.383139 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.383275 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.383451 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.383579 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.383759 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:36:12.383884 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.384076 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.384212 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.384421 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.384558 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.384755 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.384888 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.385065 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.385193 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.385384 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.385517 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.385704 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.385840 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.386018 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.386145 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.386326 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.386461 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.386636 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.386777 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.386956 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.387096 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.387264 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.387393 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.387572 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.387706 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.387880 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.388009 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.388192 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.388353 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.388591 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.388725 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.388916 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.389083 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.389220 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.389347 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.389507 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.389670 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.389807 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.390127 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.390454 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.390766 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.391087 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.391214 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.391400 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.391530 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.391736 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.391872 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.392011 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.392223 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.392368 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.392495 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.392634 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.392760 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.392977 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.393130 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.393295 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.393425 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.393613 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.393742 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.393925 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.394074 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.394243 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.394372 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.394555 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.394688 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.394867 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.395004 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.395176 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.395304 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.395479 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.395608 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.395783 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.395914 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.396086 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.396214 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.396422 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.396667 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.396810 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.396987 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.397130 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.397301 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.397435 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.397608 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.397752 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.397916 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.398044 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.398225 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.398366 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.398540 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.398678 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.398851 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.398979 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.399159 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.399288 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.399464 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.399600 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.399774 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.399903 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.400077 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.400203 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.400406 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.400535 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.400712 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.400846 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.401012 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.401148 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.401313 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.401442 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.401613 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.401741 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.401950 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.402086 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.402220 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.402366 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.402495 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.402618 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.402804 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.402947 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.403105 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.403232 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.403411 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.403568 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.403720 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.403867 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.404026 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.404750 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.404909 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.405037 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.405254 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.405400 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.405588 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.405721 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.405895 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.406030 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.406204 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.406341 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.406504 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.406634 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.406822 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.406950 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.407129 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.407267 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.407430 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.407559 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.407747 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.407875 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.408046 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.408175 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.408369 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.408499 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.408681 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.408810 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.408990 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.409124 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.409292 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.409419 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.409594 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.409721 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.409897 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.410045 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.410180 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.410314 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.410486 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.410637 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.410799 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.410948 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.411107 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.411241 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.411413 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.411552 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.411722 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.411854 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.412070 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.412222 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.412460 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.412599 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.412726 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.412850 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.412974 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.413098 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.413245 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.413382 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.413544 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.413673 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.413847 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.413974 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.414144 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.414274 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.414453 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.414582 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.414751 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.414879 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.415052 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.415188 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.415352 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.415487 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.415651 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.415778 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.415952 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.416081 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.416268 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.416414 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.416595 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.416723 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.416893 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.417024 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.417193 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.417322 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.417490 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.417617 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.417825 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.417961 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.418127 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.418256 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.418463 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.418599 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.418790 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.418921 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.419101 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.419253 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.419417 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.419554 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.419722 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.420445 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.420575 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.420804 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.420936 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.421183 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.421323 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.421490 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.421627 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.421798 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.421927 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.422145 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.422338 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.422466 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.422589 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.422714 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.422847 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.423014 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.423150 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.423333 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.423487 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.423640 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.423802 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.424004 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.424140 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.424272 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.424449 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.424586 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.424727 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.424888 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.425024 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.425205 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.425334 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.425515 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.425657 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.425833 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.425972 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.426140 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.426278 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.426450 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.426585 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.426755 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.426891 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.427058 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.427195 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.427364 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.427502 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.427671 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.427807 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.427976 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.428102 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.428278 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.428466 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.428613 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.428739 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.428921 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.429057 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.429233 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.429374 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.429545 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.429681 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.429850 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.429987 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.430154 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.430290 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.430460 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.430593 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.430766 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.430907 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.431073 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.431201 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.431386 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.431521 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.431693 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.431842 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.432004 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.432131 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.432379 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.432516 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.432641 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.432782 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.432937 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.433073 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.433235 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.433372 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.433538 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.433677 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.433842 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.433971 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.434146 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.434273 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.434450 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.434578 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.434753 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.434880 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.435049 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.435175 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.435357 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.435531 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.435730 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.435973 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.436134 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.436261 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.436434 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.436563 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.436700 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.436828 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.436992 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.437121 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.437304 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.437434 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.437616 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.437753 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.437931 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.438059 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.438232 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.438367 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.438533 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.438670 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.438842 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.438981 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.439145 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.439271 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.439445 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.439588 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.439745 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.439883 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.440043 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.440179 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.440388 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.440529 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.440696 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.440833 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.440997 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.441125 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.441297 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.441431 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.441614 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.441746 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.441903 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.442029 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.442213 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.442487 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.442648 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.442801 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.442931 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.443117 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.443247 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.443423 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.443560 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.443726 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.443854 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.444028 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.444158 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.444352 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.444509 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.444646 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.444772 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.444948 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.445081 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.445262 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.445400 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.445566 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.445704 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.445868 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.445991 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.446171 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.446300 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.446469 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.446599 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.446770 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.446900 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.447074 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.447223 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.447381 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.447629 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.447764 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.447955 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.448092 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.448325 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.448458 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.448594 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.448728 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.448885 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.449005 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.449197 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.449336 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.449498 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.449634 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.449808 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.449945 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.450111 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.450248 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.450432 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.450574 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.450741 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.450869 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.451559 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.451707 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.451853 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.452101 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.452230 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.452438 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.452600 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.452793 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.452921 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.453054 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.453193 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.453339 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.453476 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.453602 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.453768 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.453904 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.454074 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.454202 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.454379 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.454509 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.454702 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.454830 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.455005 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.455133 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.455309 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.455439 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.455611 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.455737 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.455908 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.456050 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.456212 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.456357 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.456540 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.456682 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.456840 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.456982 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.457141 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.457280 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.457437 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.457566 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.457745 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.457882 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.458048 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.458223 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.458368 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.458497 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.458634 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.458768 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.458954 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.459086 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.459261 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.459390 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.459566 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.459698 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.459869 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.459999 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.460180 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.460348 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.460516 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.460647 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.460820 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.460956 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.461125 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.461251 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.461424 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.461558 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.461715 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.461842 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.462018 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.462146 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.462318 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.462447 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.462619 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.462747 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.462950 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.463090 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.463218 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.463342 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.463494 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.463623 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.463789 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.463927 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.464098 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.464227 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.464424 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.464553 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.464724 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.464869 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.465021 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.465150 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.465321 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.465454 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.465668 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.465815 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.465944 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.466077 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.466193 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.466315 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.466491 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.466620 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.467351 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.467489 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.467655 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.467909 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.468057 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.468223 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.468380 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.468555 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.468693 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.468859 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.468996 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.469156 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.469286 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.469457 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.469584 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.469762 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.469900 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.470058 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.470189 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.470357 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.470486 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.470658 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.470786 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.470954 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.471081 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.471251 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.471378 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.471555 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.471684 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.471864 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.471991 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.472169 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.472315 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.472487 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.472616 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.472797 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.472943 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.473146 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.473275 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.473421 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.473550 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.473688 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.473816 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.473941 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.474086 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.474225 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.474390 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.474525 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.474704 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.474833 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.475036 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.475171 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.475316 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.475446 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.475622 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.475751 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.475931 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.476079 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.476227 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.476397 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.476551 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.476691 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.476847 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.476996 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.477166 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.477293 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.477467 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.477605 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.477779 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.477907 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.478102 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.478241 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.478411 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.478546 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.478723 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.478853 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.479027 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.479155 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.479332 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.479468 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.479640 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.479767 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.479935 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.480061 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.480241 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.480400 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.480570 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.480699 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.480876 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.481007 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.481172 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.481309 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.481472 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.481607 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.481780 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.481908 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.482080 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.482208 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.482407 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.482679 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.482809 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.483024 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.483172 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.483362 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.483489 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.483613 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.483738 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.483911 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.484049 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.484212 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.484374 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.484537 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.484665 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.484840 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.484982 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.485142 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.485279 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.485444 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.485572 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.485750 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.485880 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.486306 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.486498 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.486626 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.486814 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.486951 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.487126 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.487255 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.487431 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.487560 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.487743 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.487879 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.488048 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.488175 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.488386 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.488529 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.488742 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.488898 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.489029 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.489153 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.489277 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.489401 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.489544 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.489714 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.489856 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.490026 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.490155 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.490338 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.490523 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.490670 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.490828 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.490956 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.491131 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.491266 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.491430 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.491559 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.491730 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.491859 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.492031 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.492168 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.492357 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.492486 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.492664 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.492801 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.492962 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.493100 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.493414 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.493551 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.493676 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.493799 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.493950 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.494088 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.494252 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.494380 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.494548 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.494747 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.494875 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.495058 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.495200 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.495368 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.495496 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.495690 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.495818 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.496000 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.496136 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.496316 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.496447 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.496630 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.496770 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.496930 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.497058 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.497240 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.497369 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.497565 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.497702 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.497905 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.498076 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.498292 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.498504 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.498640 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.499051 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.499190 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.499307 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.499441 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.499565 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.499690 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.499815 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.499939 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.500076 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.500202 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.500380 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.500508 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.500647 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.500775 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.500908 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.501035 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.501166 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.501336 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.501465 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.501651 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.501789 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.501955 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.502093 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.502263 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.502399 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.502566 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.502697 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.502869 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.502997 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.503175 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.503303 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.503528 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.503665 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.503790 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.503914 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.504085 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.504221 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.504431 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.504570 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.504742 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.504873 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.505047 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.505185 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.505352 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.505490 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.505673 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.505804 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.505976 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.506118 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.506278 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.506405 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.506577 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.506705 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.506877 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.507017 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.507194 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.507324 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.507494 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.507624 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.507799 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.507952 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.508088 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.508233 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.508408 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.508536 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.508709 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.508853 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.509007 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.509157 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.509325 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.509474 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.509612 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.509754 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.509923 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.510063 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.510230 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.510358 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.510545 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.510677 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.510859 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.510996 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.511155 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.511284 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.511471 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.511608 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.511773 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.511902 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.512070 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.512226 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.512461 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.512592 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.512717 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.512842 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.513004 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.513144 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.513304 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.513434 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.514221 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.514423 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.514423 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.514749 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.514879 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.515003 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.515134 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.515261 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.515394 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.515528 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.515687 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.515817 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.515998 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.516126 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.516319 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.516464 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.516640 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.516768 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.516938 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.517065 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.517235 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.517365 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.517538 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.517667 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.517838 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.517972 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.518134 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.518275 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.518430 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.518560 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.518730 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.518865 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.519024 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.519179 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.519316 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.519444 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.519602 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.519741 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.519914 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.520044 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.520210 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.520375 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.520641 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.520782 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.520960 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.521089 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.521275 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.521412 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.521580 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.521784 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.521913 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.522038 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.522194 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.522322 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.522491 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.522629 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.522808 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.522928 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.523118 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.523245 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.523430 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.523560 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.523744 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.523874 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.524065 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.524197 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.524459 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.524592 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.524724 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.524918 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.525047 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.525235 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.525374 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.525547 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.525679 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.525855 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.525983 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.526162 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.526292 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.526468 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.526596 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.526773 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.526901 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.527082 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.527211 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.527388 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.527515 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.527697 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.527833 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.528022 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.528210 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.528398 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.528557 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.528687 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.528868 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.529073 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.529244 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.529421 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.529560 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.529742 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.529901 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.530062 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.530192 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.530381 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.530524 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.530698 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.530839 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.531005 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.531135 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.531312 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.531441 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.531631 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.531760 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.531946 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.532081 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.532262 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.532411 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.532601 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.532733 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.532914 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.533045 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.533219 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.533346 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.533528 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.533658 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.533836 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.533972 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.534145 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.534281 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.534500 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.534645 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.534779 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.534904 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.535058 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.535200 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.535366 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.535496 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.535673 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.535806 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.535978 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.536108 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.536279 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.536460 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.536608 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.536747 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.536915 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.537157 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.537287 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.537481 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.537610 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.537803 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.537940 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.538111 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.538241 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.538426 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.538555 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.538751 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.538888 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.539063 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.539190 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.539369 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.539511 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.539677 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.539813 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.539981 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.540122 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.540317 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.540513 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.540654 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.540823 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.540954 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.541149 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.541279 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.541465 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.541602 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.541780 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.541922 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.542090 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.542231 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.542400 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.542538 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.542724 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.542936 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.543082 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.543280 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.543419 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.543596 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.543737 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.543901 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.544046 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.544194 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.544371 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.544540 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.544734 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.545384 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.545510 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.545644 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.545779 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.545939 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.546069 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.546241 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.546369 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.546569 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.546767 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.546897 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.547106 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.547235 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.547415 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.547559 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.547735 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.547889 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.548054 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.548195 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.548365 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.548507 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.548679 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.548821 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.548987 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.549123 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.549287 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.549428 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.549587 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.549717 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.549898 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.550034 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.550201 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.550338 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.550515 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.550647 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.550820 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.550962 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.551127 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.551267 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.551433 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.551561 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.551731 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.551861 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.552043 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.552178 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.552345 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.552473 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.552667 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.552795 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.552971 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.553103 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.553276 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.553406 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.553575 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.553725 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.553882 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.554013 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.554180 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.554309 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.554480 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.554619 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.554826 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.554961 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.555088 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.555214 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.555369 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.555507 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.555667 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.555803 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.555971 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.556108 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.556268 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.556450 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.556599 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.556736 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.556896 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.557037 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.557199 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.557340 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.557545 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.557801 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.557935 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.558138 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.558345 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.558487 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.558621 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.558755 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.558881 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.559005 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.559139 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.559319 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.559449 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.559626 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.559770 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.559931 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.560070 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.560269 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.560466 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.560677 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.560895 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.561116 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.561256 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.561430 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.561560 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.561743 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.561873 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.562055 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.562185 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.562366 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.562498 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.562676 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.562807 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.562987 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.563118 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.563297 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.563429 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.563607 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.563737 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.563919 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.564071 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.564207 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.564378 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.564538 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.564677 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.564827 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.565037 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.565166 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.565290 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.565427 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.565567 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.565707 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.565843 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.566004 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.566148 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.566309 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.566451 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.566614 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.566745 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.566917 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.567056 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.567222 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.567369 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.567527 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.567658 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.567857 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.567988 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.568170 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.568323 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.568503 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.568651 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.568813 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.568943 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.569121 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.569253 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.569424 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.569574 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.569729 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.569876 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.570029 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.570178 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.570331 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.570472 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.570637 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.570786 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.570957 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.571089 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.571263 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.571392 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.571561 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.571701 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.571947 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.572075 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.572260 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.572449 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.572588 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.572715 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.572899 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.573030 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.573209 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.573331 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.573520 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.573666 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.573825 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.573956 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.574125 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.574265 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.574439 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.574569 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.574743 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.574872 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.575033 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.575235 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.575365 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.575491 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.575629 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.575775 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.575903 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.576608 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.576832 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.577044 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.577278 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.577429 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.577558 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.577705 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.577841 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.577968 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.578108 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.578236 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.578374 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.578512 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.578651 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.578780 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.578924 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.579054 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.579210 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.579340 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.579483 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.579612 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.579738 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.579875 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.580017 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.580151 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.580279 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.580449 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.580578 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.580716 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.580852 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.580979 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.581117 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.581248 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.581436 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.581565 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.581762 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.581906 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.582045 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.582174 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.582337 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.582477 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.582642 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.582777 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.582935 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.583065 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.583235 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.583380 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.583530 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.583660 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.583826 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.583956 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.584119 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.584264 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.584461 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.584592 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.584777 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.584908 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.585085 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.585244 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.585450 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.585594 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.585735 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.585872 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.586011 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.586137 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.586262 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.586406 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.586574 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.586704 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.586921 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.587062 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.587188 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.587321 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.587470 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.587600 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.587799 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.587930 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.588106 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.588244 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.588417 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.588534 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.588725 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.588813 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.589031 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.589128 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.589331 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.589433 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.589635 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.589723 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.589955 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.590044 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.590274 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.590370 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.590576 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.590671 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.590893 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.590979 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.591207 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.591309 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.591525 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.591612 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.592437 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.592534 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.592774 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.592875 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.593084 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.593173 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.593413 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.593500 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.593742 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.593841 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.594051 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.594145 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.594359 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.594453 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.594666 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.594761 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.594977 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.595064 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.595290 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.595385 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.595613 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.595717 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.595921 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.596021 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.596165 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 16:36:12.596261 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.596558 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.596880 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.597229 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.597536 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.597874 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.598196 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.598502 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.598805 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.599107 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:36:12.599344 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 16:36:12.656090 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO dbcounter [None req-1cf3257f-b104-465b-b87c-a120eb31e29b None None] Registered counter for database nova_api May 23 16:36:12.660275 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO dbcounter [None req-a97262e0-5707-449b-b609-2078473268d9 None None] Registered counter for database nova_api May 23 16:36:12.676856 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_db.sqlalchemy.engines [None req-1cf3257f-b104-465b-b87c-a120eb31e29b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110286) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 16:36:12.679472 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG oslo_db.sqlalchemy.engines [None req-a97262e0-5707-449b-b609-2078473268d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 16:36:12.683531 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG dbcounter [-] [110286] Writer thread running {{(pid=110286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 16:36:12.685965 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG dbcounter [-] [110285] Writer thread running {{(pid=110285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 16:36:12.741957 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.context [None req-1cf3257f-b104-465b-b87c-a120eb31e29b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3da232e7-0be9-4eeb-8f07-26e17f9287c7(cell1) {{(pid=110286) load_cells /opt/stack/nova/nova/context.py:464}} May 23 16:36:12.743068 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.context [None req-a97262e0-5707-449b-b609-2078473268d9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3da232e7-0be9-4eeb-8f07-26e17f9287c7(cell1) {{(pid=110285) load_cells /opt/stack/nova/nova/context.py:464}} May 23 16:36:12.745998 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_concurrency.lockutils [None req-1cf3257f-b104-465b-b87c-a120eb31e29b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:36:12.747112 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG oslo_concurrency.lockutils [None req-a97262e0-5707-449b-b609-2078473268d9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:36:12.747764 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_concurrency.lockutils [None req-1cf3257f-b104-465b-b87c-a120eb31e29b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:36:12.749042 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_concurrency.lockutils [None req-1cf3257f-b104-465b-b87c-a120eb31e29b None None] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:36:12.749188 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG oslo_concurrency.lockutils [None req-a97262e0-5707-449b-b609-2078473268d9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:36:12.749964 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG oslo_concurrency.lockutils [None req-a97262e0-5707-449b-b609-2078473268d9 None None] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:36:12.751910 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG oslo_concurrency.lockutils [None req-a97262e0-5707-449b-b609-2078473268d9 None None] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:36:12.752533 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_concurrency.lockutils [None req-1cf3257f-b104-465b-b87c-a120eb31e29b None None] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=110286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:36:12.754029 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO dbcounter [None req-a97262e0-5707-449b-b609-2078473268d9 None None] Registered counter for database nova_cell0 May 23 16:36:12.754811 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO dbcounter [None req-1cf3257f-b104-465b-b87c-a120eb31e29b None None] Registered counter for database nova_cell0 May 23 16:36:12.758283 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO dbcounter [None req-a97262e0-5707-449b-b609-2078473268d9 None None] Registered counter for database nova_cell1 May 23 16:36:12.758789 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO dbcounter [None req-1cf3257f-b104-465b-b87c-a120eb31e29b None None] Registered counter for database nova_cell1 May 23 16:36:12.766187 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG oslo_db.sqlalchemy.engines [None req-a97262e0-5707-449b-b609-2078473268d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 16:36:12.767881 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG oslo_db.sqlalchemy.engines [None req-a97262e0-5707-449b-b609-2078473268d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 16:36:12.769734 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_db.sqlalchemy.engines [None req-1cf3257f-b104-465b-b87c-a120eb31e29b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110286) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 16:36:12.771541 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_db.sqlalchemy.engines [None req-1cf3257f-b104-465b-b87c-a120eb31e29b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110286) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 16:36:12.773359 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG dbcounter [-] [110285] Writer thread running {{(pid=110285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 16:36:12.777468 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG dbcounter [-] [110286] Writer thread running {{(pid=110286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 16:36:12.778583 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG dbcounter [-] [110285] Writer thread running {{(pid=110285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 16:36:12.779077 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG dbcounter [-] [110286] Writer thread running {{(pid=110286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 16:36:12.923101 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO dbcounter [None req-a97262e0-5707-449b-b609-2078473268d9 None None] Registered counter for database nova_cell0 May 23 16:36:12.930692 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO dbcounter [None req-1cf3257f-b104-465b-b87c-a120eb31e29b None None] Registered counter for database nova_cell0 May 23 16:36:12.931796 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG oslo_db.sqlalchemy.engines [None req-a97262e0-5707-449b-b609-2078473268d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 16:36:12.936862 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG dbcounter [-] [110285] Writer thread running {{(pid=110285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 16:36:12.940587 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_db.sqlalchemy.engines [None req-1cf3257f-b104-465b-b87c-a120eb31e29b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110286) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 16:36:12.944976 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG dbcounter [-] [110286] Writer thread running {{(pid=110286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 16:36:13.352393 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: WARNING keystonemiddleware.auth_token [None req-1cf3257f-b104-465b-b87c-a120eb31e29b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 16:36:13.357128 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: WARNING keystonemiddleware.auth_token [None req-a97262e0-5707-449b-b609-2078473268d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 16:36:13.360152 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: WARNING keystonemiddleware.auth_token [None req-1cf3257f-b104-465b-b87c-a120eb31e29b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 16:36:13.366029 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: WARNING keystonemiddleware.auth_token [None req-a97262e0-5707-449b-b609-2078473268d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 16:36:13.706025 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: WARNING keystonemiddleware.auth_token [None req-1cf3257f-b104-465b-b87c-a120eb31e29b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 16:36:13.712008 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: WARNING keystonemiddleware.auth_token [None req-1cf3257f-b104-465b-b87c-a120eb31e29b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 16:36:13.718097 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55654b7e89c0 pid: 110286 (default app) May 23 16:36:13.720157 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-1cf3257f-b104-465b-b87c-a120eb31e29b None None] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:36:13.721373 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-1cf3257f-b104-465b-b87c-a120eb31e29b None None] 10.222.0.74 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001767 May 23 16:36:13.721793 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 1/1] 10.222.0.74 () {50 vars in 788 bytes} [Mon May 23 16:36:13 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:36:13.727364 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: WARNING keystonemiddleware.auth_token [None req-a97262e0-5707-449b-b609-2078473268d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 16:36:13.734465 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: WARNING keystonemiddleware.auth_token [None req-a97262e0-5707-449b-b609-2078473268d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 16:36:13.740014 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55654b7e89c0 pid: 110285 (default app) May 23 16:37:34.952722 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-1cf3257f-b104-465b-b87c-a120eb31e29b None None] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:37:34.954315 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-1cf3257f-b104-465b-b87c-a120eb31e29b None None] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002172 May 23 16:37:34.954864 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 2/2] 10.222.0.74 () {54 vars in 930 bytes} [Mon May 23 16:37:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:37:34.972510 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG dbcounter [-] [110285] Writing DB stats nova_api:SELECT=3 {{(pid=110285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:37:34.973491 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG dbcounter [-] [110285] Writing DB stats nova_cell1:SELECT=3 {{(pid=110285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:37:34.974250 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG dbcounter [-] [110285] Writing DB stats nova_cell0:SELECT=3 {{(pid=110285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:37:34.975193 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG dbcounter [-] [110285] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:37:35.433811 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-1f924a6c-4a5f-48a8-985d-ead9cfcf8687 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:37:35.463801 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-1f924a6c-4a5f-48a8-985d-ead9cfcf8687 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.502080 May 23 16:37:35.472409 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 1/3] 10.222.0.74 () {60 vars in 1291 bytes} [Mon May 23 16:37:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:37:37.745419 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-1cf3257f-b104-465b-b87c-a120eb31e29b None None] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:37:37.746502 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-1cf3257f-b104-465b-b87c-a120eb31e29b None None] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 23 16:37:37.747069 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 3/4] 10.222.0.74 () {54 vars in 930 bytes} [Mon May 23 16:37:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:37:37.815092 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-122f5327-ff7a-40d3-8003-4085e92907ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "id": "c1", "swap": 0, "name": "cirros256", "ram": 256, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:37:37.834521 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 16:37:37.834521 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: warnings.warn(msg) May 23 16:37:37.949857 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-122f5327-ff7a-40d3-8003-4085e92907ec admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.196563 May 23 16:37:37.958150 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 2/5] 10.222.0.74 () {64 vars in 1282 bytes} [Mon May 23 16:37:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 16:37:37.965178 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG dbcounter [-] [110286] Writing DB stats nova_api:SELECT=3 {{(pid=110286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:37:37.966676 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG dbcounter [-] [110286] Writing DB stats nova_cell1:SELECT=3 {{(pid=110286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:37:37.967707 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG dbcounter [-] [110286] Writing DB stats nova_cell0:SELECT=3 {{(pid=110286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:37:37.970972 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG dbcounter [-] [110286] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:37:38.179562 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-ba4ca65a-2c59-4d7f-8543-8b0b89b09961 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:37:38.183670 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 16:37:38.183670 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: warnings.warn(msg) May 23 16:37:38.308676 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-ba4ca65a-2c59-4d7f-8543-8b0b89b09961 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.349177 May 23 16:37:38.309583 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 4/6] 10.222.0.74 () {64 vars in 1335 bytes} [Mon May 23 16:37:37 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:37:40.621702 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-122f5327-ff7a-40d3-8003-4085e92907ec admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:37:40.622715 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-122f5327-ff7a-40d3-8003-4085e92907ec admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 23 16:37:40.623266 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 3/7] 10.222.0.74 () {54 vars in 930 bytes} [Mon May 23 16:37:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:37:40.733130 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-4707e273-7f67-4942-9f32-b11ab8c9ca0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "disk": 5, "name": "ds512M", "rxtx_factor": 1.0, "ram": 512, "id": "d1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:37:40.751528 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 16:37:40.751528 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: warnings.warn(msg) May 23 16:37:40.834982 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-4707e273-7f67-4942-9f32-b11ab8c9ca0f admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.205950 May 23 16:37:40.835473 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 5/8] 10.222.0.74 () {64 vars in 1282 bytes} [Mon May 23 16:37:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 16:37:40.848412 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-5da9f8a2-89c3-4e47-a7e3-67ca672ac0bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:37:40.849979 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 16:37:40.849979 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: warnings.warn(msg) May 23 16:37:40.966863 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-5da9f8a2-89c3-4e47-a7e3-67ca672ac0bf admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.122078 May 23 16:37:40.968524 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 4/9] 10.222.0.74 () {64 vars in 1335 bytes} [Mon May 23 16:37:40 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:37:43.221643 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-4707e273-7f67-4942-9f32-b11ab8c9ca0f admin admin] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:37:43.231523 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-4707e273-7f67-4942-9f32-b11ab8c9ca0f admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.009914 May 23 16:37:43.236358 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 6/10] 10.222.0.74 () {54 vars in 930 bytes} [Mon May 23 16:37:43 2022] GET /compute/v2.1 => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:37:43.298831 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-1a6f0045-2004-495c-8dca-1f65a7fe6f23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024, "name": "ds1G", "os-flavor-access:is_public": true, "swap": 0, "id": "d2", "disk": 10}} {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:37:43.395462 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-1a6f0045-2004-495c-8dca-1f65a7fe6f23 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.156498 May 23 16:37:43.396116 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 5/11] 10.222.0.74 () {64 vars in 1282 bytes} [Mon May 23 16:37:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 16:37:43.408382 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-0a55985b-0d05-4f82-86ea-95bdc853b3ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:37:43.490246 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-0a55985b-0d05-4f82-86ea-95bdc853b3ed admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085531 May 23 16:37:43.491075 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 7/12] 10.222.0.74 () {64 vars in 1335 bytes} [Mon May 23 16:37:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:37:45.837911 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-1a6f0045-2004-495c-8dca-1f65a7fe6f23 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:37:45.843519 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-1a6f0045-2004-495c-8dca-1f65a7fe6f23 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 May 23 16:37:45.843519 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 6/13] 10.222.0.74 () {54 vars in 930 bytes} [Mon May 23 16:37:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:37:45.905783 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-5a71b413-64c4-470e-9e7f-0a1809a05086 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "name": "ds2G", "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "swap": 0, "disk": 10}} {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:37:45.985388 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-5a71b413-64c4-470e-9e7f-0a1809a05086 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139190 May 23 16:37:45.985944 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 8/14] 10.222.0.74 () {64 vars in 1282 bytes} [Mon May 23 16:37:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 16:37:45.998102 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-3249e903-b1b1-451f-86dc-ff649e4fb7b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:37:46.084326 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-3249e903-b1b1-451f-86dc-ff649e4fb7b1 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089991 May 23 16:37:46.084878 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 7/15] 10.222.0.74 () {64 vars in 1335 bytes} [Mon May 23 16:37:45 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:37:48.353220 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-5a71b413-64c4-470e-9e7f-0a1809a05086 admin admin] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:37:48.354239 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-5a71b413-64c4-470e-9e7f-0a1809a05086 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 May 23 16:37:48.354640 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 9/16] 10.222.0.74 () {54 vars in 930 bytes} [Mon May 23 16:37:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:37:48.414846 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-13698bd8-4031-4579-a501-f326f127910d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "disk": 20, "vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "rxtx_factor": 1.0}} {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:37:48.515993 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-13698bd8-4031-4579-a501-f326f127910d admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.155056 May 23 16:37:48.516915 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 8/17] 10.222.0.74 () {64 vars in 1282 bytes} [Mon May 23 16:37:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 16:37:48.528607 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-97496356-255c-44f9-85e8-92d6abae686e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:37:48.632081 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-97496356-255c-44f9-85e8-92d6abae686e admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107278 May 23 16:37:48.633318 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 10/18] 10.222.0.74 () {64 vars in 1335 bytes} [Mon May 23 16:37:48 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:37:50.935194 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-13698bd8-4031-4579-a501-f326f127910d admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:37:50.936214 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-13698bd8-4031-4579-a501-f326f127910d admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 May 23 16:37:50.936688 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 9/19] 10.222.0.74 () {54 vars in 930 bytes} [Mon May 23 16:37:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:37:50.999128 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-de06ad00-6af3-4e46-8750-1b7ad2f57da4 admin admin] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:37:51.022796 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-de06ad00-6af3-4e46-8750-1b7ad2f57da4 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079744 May 23 16:37:51.024234 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 11/20] 10.222.0.74 () {60 vars in 1291 bytes} [Mon May 23 16:37:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:37:53.315912 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-13698bd8-4031-4579-a501-f326f127910d admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:37:53.316968 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-13698bd8-4031-4579-a501-f326f127910d admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 May 23 16:37:53.317378 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 10/21] 10.222.0.74 () {54 vars in 930 bytes} [Mon May 23 16:37:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:37:53.387895 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-0398f0c0-79a8-4e30-843a-41ae43532cd0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "m1.tiny", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "1", "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1}} {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:37:53.519697 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-0398f0c0-79a8-4e30-843a-41ae43532cd0 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.195313 May 23 16:37:53.520281 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 12/22] 10.222.0.74 () {64 vars in 1282 bytes} [Mon May 23 16:37:53 2022] POST /compute/v2.1/flavors => generated 402 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 16:37:53.532826 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-ec639d97-c027-4595-b44c-27c286b390ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:37:53.669401 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-ec639d97-c027-4595-b44c-27c286b390ca admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.140229 May 23 16:37:53.670005 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 11/23] 10.222.0.74 () {64 vars in 1332 bytes} [Mon May 23 16:37:53 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:37:56.028817 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-0398f0c0-79a8-4e30-843a-41ae43532cd0 admin admin] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:37:56.029878 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-0398f0c0-79a8-4e30-843a-41ae43532cd0 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 May 23 16:37:56.030295 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 13/24] 10.222.0.74 () {54 vars in 930 bytes} [Mon May 23 16:37:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:37:56.091825 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-41c7d5cc-ff84-4df7-9e96-f2033e25cec8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.small", "ram": 2048, "disk": 20, "rxtx_factor": 1.0, "vcpus": 1, "id": "2"}} {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:37:56.166225 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-41c7d5cc-ff84-4df7-9e96-f2033e25cec8 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.128648 May 23 16:37:56.167188 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 12/25] 10.222.0.74 () {64 vars in 1282 bytes} [Mon May 23 16:37:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 16:37:56.179581 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-79b0725f-91c4-48ac-98cb-9ae787a578b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:37:56.256561 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-79b0725f-91c4-48ac-98cb-9ae787a578b5 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080872 May 23 16:37:56.257657 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 14/26] 10.222.0.74 () {64 vars in 1332 bytes} [Mon May 23 16:37:56 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:37:58.543139 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-41c7d5cc-ff84-4df7-9e96-f2033e25cec8 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:37:58.544147 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-41c7d5cc-ff84-4df7-9e96-f2033e25cec8 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 23 16:37:58.544581 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 13/27] 10.222.0.74 () {54 vars in 930 bytes} [Mon May 23 16:37:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:37:58.603137 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-416b166e-5bf9-49e4-a0c6-7c79b3eb32c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "ram": 4096, "disk": 40, "rxtx_factor": 1.0, "id": "3", "vcpus": 2, "swap": 0}} {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:37:58.734105 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-416b166e-5bf9-49e4-a0c6-7c79b3eb32c7 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.183720 May 23 16:37:58.734679 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 15/28] 10.222.0.74 () {64 vars in 1282 bytes} [Mon May 23 16:37:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 16:37:58.746925 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-2abfc569-f594-4aac-953a-6fc2fb3b7845 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:37:58.959155 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-2abfc569-f594-4aac-953a-6fc2fb3b7845 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.215956 May 23 16:37:58.959746 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 14/29] 10.222.0.74 () {64 vars in 1332 bytes} [Mon May 23 16:37:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:38:01.297112 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-416b166e-5bf9-49e4-a0c6-7c79b3eb32c7 admin admin] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:01.298128 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-416b166e-5bf9-49e4-a0c6-7c79b3eb32c7 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 May 23 16:38:01.298523 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 16/30] 10.222.0.74 () {54 vars in 930 bytes} [Mon May 23 16:38:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:38:01.355419 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-d19ebb75-3795-4f53-9ddb-61f843bb206c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 8192, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "name": "m1.large", "vcpus": 4, "disk": 80, "rxtx_factor": 1.0}} {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:38:01.452280 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-d19ebb75-3795-4f53-9ddb-61f843bb206c admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.147135 May 23 16:38:01.452851 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 15/31] 10.222.0.74 () {64 vars in 1282 bytes} [Mon May 23 16:38:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 16:38:01.466105 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-9f22e499-976c-4075-9cf4-b42726389356 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:38:01.603518 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-9f22e499-976c-4075-9cf4-b42726389356 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.141213 May 23 16:38:01.608761 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 17/32] 10.222.0.74 () {64 vars in 1332 bytes} [Mon May 23 16:38:01 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:38:04.040734 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-d19ebb75-3795-4f53-9ddb-61f843bb206c admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:04.042352 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-d19ebb75-3795-4f53-9ddb-61f843bb206c admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002075 May 23 16:38:04.042747 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 16/33] 10.222.0.74 () {54 vars in 930 bytes} [Mon May 23 16:38:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:38:04.112470 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-c63fb194-8c77-415a-9b35-8318588bdc51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "5", "vcpus": 8, "rxtx_factor": 1.0, "swap": 0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "ram": 16384}} {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:38:04.559629 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-c63fb194-8c77-415a-9b35-8318588bdc51 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.510745 May 23 16:38:04.560514 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 18/34] 10.222.0.74 () {64 vars in 1282 bytes} [Mon May 23 16:38:04 2022] POST /compute/v2.1/flavors => generated 408 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 16:38:04.572425 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-1de3f4d2-4bca-47b4-97a0-d8eb4eb9b418 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:38:04.695197 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-1de3f4d2-4bca-47b4-97a0-d8eb4eb9b418 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126603 May 23 16:38:04.695781 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 17/35] 10.222.0.74 () {64 vars in 1332 bytes} [Mon May 23 16:38:04 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:38:29.988386 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-c63fb194-8c77-415a-9b35-8318588bdc51 admin admin] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:29.989472 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-c63fb194-8c77-415a-9b35-8318588bdc51 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 May 23 16:38:29.989864 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 19/36] 10.222.0.74 () {54 vars in 930 bytes} [Mon May 23 16:38:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:38:30.000762 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG dbcounter [-] [110285] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=110285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:38:30.051242 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-2dd4814f-577e-477f-9e62-7aa606210a40 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:30.069225 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-2dd4814f-577e-477f-9e62-7aa606210a40 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073319 May 23 16:38:30.071272 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 18/37] 10.222.0.74 () {60 vars in 1291 bytes} [Mon May 23 16:38:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:38:31.068747 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-c63fb194-8c77-415a-9b35-8318588bdc51 admin admin] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:31.069748 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-c63fb194-8c77-415a-9b35-8318588bdc51 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 23 16:38:31.070138 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 20/38] 10.222.0.74 () {56 vars in 1074 bytes} [Mon May 23 16:38:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:38:31.311282 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-9512c6b9-7e90-4a5c-bf46-904147d8d224 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:31.317727 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.wsgi [None req-9512c6b9-7e90-4a5c-bf46-904147d8d224 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 23 16:38:31.320941 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-9512c6b9-7e90-4a5c-bf46-904147d8d224 admin admin] Request method failure captured: May 23 16:38:31.320941 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 23 16:38:31.320941 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: Accept: application/json May 23 16:38:31.320941 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: Accept-Encoding: gzip, deflate May 23 16:38:31.320941 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: Connection: keep-alive May 23 16:38:31.320941 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: Content-Length: 0 May 23 16:38:31.320941 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: Host: 10.222.0.74 May 23 16:38:31.320941 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: Openstack-Api-Version: compute 2.90 May 23 16:38:31.320941 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: Openstack-System-Scope: None May 23 16:38:31.320941 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: User-Agent: python-novaclient May 23 16:38:31.320941 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Auth-Token: gAAAAABii7iHDTId3pwQLEVTn-ko30HJveeFwHhpoeS3emBCcZECriMOoBcSYUtyWqwKrdz_0C9hkz0Y4gvm4b1qT9MKr70pKo07ckMzVRBmWh869KisyNt3KNerx2tpVW5IhP9bEhfcc6offz8rwN2eteXaDOahZjvAc7vS5_lm-_Ar-zjBMmQ May 23 16:38:31.320941 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Domain-Id: None May 23 16:38:31.320941 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Domain-Name: None May 23 16:38:31.320941 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Identity-Status: Confirmed May 23 16:38:31.320941 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Is-Admin-Project: True May 23 16:38:31.320941 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Openstack-Nova-Api-Version: 2.90 May 23 16:38:31.320941 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Project-Domain-Id: default May 23 16:38:31.320941 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Project-Domain-Name: Default May 23 16:38:31.320941 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Project-Id: a06edcae6b7a4521b29d4cfac1cfa2c1 May 23 16:38:31.320941 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Project-Name: admin May 23 16:38:31.320941 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Role: admin,member,reader May 23 16:38:31.320941 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Roles: admin,member,reader May 23 16:38:31.322677 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:38:31.322677 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Tenant: admin May 23 16:38:31.322677 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Tenant-Id: a06edcae6b7a4521b29d4cfac1cfa2c1 May 23 16:38:31.322677 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Tenant-Name: admin May 23 16:38:31.322677 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-User: admin May 23 16:38:31.322677 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-User-Domain-Id: default May 23 16:38:31.322677 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-User-Domain-Name: Default May 23 16:38:31.322677 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-User-Id: 9f0fe22fa44447e8acda5720d7e2ffa6 May 23 16:38:31.322677 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-User-Name: admin May 23 16:38:31.322677 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: method: > May 23 16:38:31.322677 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: exception: Flavor 42 could not be found. May 23 16:38:31.322677 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: action_args: {'id': '42'} May 23 16:38:31.322677 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:38:31.322677 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:38:31.323592 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 16:38:31.323592 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 16:38:31.323592 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 16:38:31.323592 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 16:38:31.323592 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 16:38:31.323592 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 16:38:31.323592 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 16:38:31.323592 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 16:38:31.323592 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 16:38:31.323592 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:38:31.323592 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 16:38:31.323592 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 16:38:31.323592 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 23 16:38:31.323592 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 23 16:38:31.323592 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:38:31.323592 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 23 16:38:31.323592 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:38:31.323592 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:38:31.323592 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:38:31.327894 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:38:31.327894 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:38:31.327894 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:38:31.327894 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:38:31.327894 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 16:38:31.327894 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 16:38:31.327894 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 23 16:38:31.327894 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 23 16:38:31.327894 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:38:31.327894 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 23 16:38:31.327894 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:38:31.327894 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:38:31.327894 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:38:31.327894 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:38:31.327894 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:38:31.327894 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 23 16:38:31.327894 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 23 16:38:31.327894 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-9512c6b9-7e90-4a5c-bf46-904147d8d224 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:38:31.329361 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-9512c6b9-7e90-4a5c-bf46-904147d8d224 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062725 May 23 16:38:31.329361 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 19/39] 10.222.0.74 () {60 vars in 1190 bytes} [Mon May 23 16:38:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 16:38:31.332391 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-5534a910-27b2-48dd-96a4-afcd02d7d67b admin admin] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:31.336587 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG dbcounter [-] [110286] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:38:31.355183 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-5534a910-27b2-48dd-96a4-afcd02d7d67b admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026347 May 23 16:38:31.355714 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 21/40] 10.222.0.74 () {60 vars in 1210 bytes} [Mon May 23 16:38:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:38:31.365933 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-ede623fd-0814-4043-bea2-a569cbb09958 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:31.387390 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-ede623fd-0814-4043-bea2-a569cbb09958 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025367 May 23 16:38:31.387924 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 20/41] 10.222.0.74 () {60 vars in 1210 bytes} [Mon May 23 16:38:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:38:31.397749 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-8eaa85b2-1b31-4474-9034-a0b85902be8c admin admin] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:31.403812 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.wsgi [None req-8eaa85b2-1b31-4474-9034-a0b85902be8c admin admin] HTTP exception thrown: Flavor 42 could not be found. May 23 16:38:31.407021 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-8eaa85b2-1b31-4474-9034-a0b85902be8c admin admin] Request method failure captured: May 23 16:38:31.407021 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 23 16:38:31.407021 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: Accept: application/json May 23 16:38:31.407021 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: Accept-Encoding: gzip, deflate May 23 16:38:31.407021 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: Connection: keep-alive May 23 16:38:31.407021 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: Content-Length: 0 May 23 16:38:31.407021 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: Host: 10.222.0.74 May 23 16:38:31.407021 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: Openstack-Api-Version: compute 2.90 May 23 16:38:31.407021 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: Openstack-System-Scope: None May 23 16:38:31.407021 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: User-Agent: python-novaclient May 23 16:38:31.407021 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Auth-Token: gAAAAABii7iHDTId3pwQLEVTn-ko30HJveeFwHhpoeS3emBCcZECriMOoBcSYUtyWqwKrdz_0C9hkz0Y4gvm4b1qT9MKr70pKo07ckMzVRBmWh869KisyNt3KNerx2tpVW5IhP9bEhfcc6offz8rwN2eteXaDOahZjvAc7vS5_lm-_Ar-zjBMmQ May 23 16:38:31.407021 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Domain-Id: None May 23 16:38:31.407021 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Domain-Name: None May 23 16:38:31.407021 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Identity-Status: Confirmed May 23 16:38:31.407021 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Is-Admin-Project: True May 23 16:38:31.407021 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Openstack-Nova-Api-Version: 2.90 May 23 16:38:31.407021 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Project-Domain-Id: default May 23 16:38:31.407021 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Project-Domain-Name: Default May 23 16:38:31.407021 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Project-Id: a06edcae6b7a4521b29d4cfac1cfa2c1 May 23 16:38:31.407021 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Project-Name: admin May 23 16:38:31.407021 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Role: admin,member,reader May 23 16:38:31.407021 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Roles: admin,member,reader May 23 16:38:31.408750 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:38:31.408750 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Tenant: admin May 23 16:38:31.408750 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Tenant-Id: a06edcae6b7a4521b29d4cfac1cfa2c1 May 23 16:38:31.408750 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Tenant-Name: admin May 23 16:38:31.408750 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-User: admin May 23 16:38:31.408750 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-User-Domain-Id: default May 23 16:38:31.408750 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-User-Domain-Name: Default May 23 16:38:31.408750 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-User-Id: 9f0fe22fa44447e8acda5720d7e2ffa6 May 23 16:38:31.408750 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-User-Name: admin May 23 16:38:31.408750 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: method: > May 23 16:38:31.408750 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: exception: Flavor 42 could not be found. May 23 16:38:31.408750 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: action_args: {'id': '42'} May 23 16:38:31.408750 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:38:31.408750 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:38:31.409972 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 16:38:31.409972 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 16:38:31.409972 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 16:38:31.409972 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 16:38:31.409972 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 16:38:31.409972 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 16:38:31.409972 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 16:38:31.409972 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 16:38:31.409972 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 16:38:31.409972 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:38:31.409972 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 16:38:31.409972 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 16:38:31.409972 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 23 16:38:31.409972 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi May 23 16:38:31.409972 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:38:31.409972 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi May 23 16:38:31.409972 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:38:31.409972 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:38:31.409972 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:38:31.411542 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:38:31.411542 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:38:31.411542 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:38:31.411542 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:38:31.411542 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 16:38:31.411542 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 16:38:31.411542 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 23 16:38:31.411542 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi May 23 16:38:31.411542 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:38:31.411542 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi May 23 16:38:31.411542 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:38:31.411542 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:38:31.411542 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:38:31.411542 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:38:31.411542 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:38:31.411542 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 23 16:38:31.411542 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi May 23 16:38:31.411542 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-8eaa85b2-1b31-4474-9034-a0b85902be8c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:38:31.421545 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-8eaa85b2-1b31-4474-9034-a0b85902be8c admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014770 May 23 16:38:31.421545 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 22/42] 10.222.0.74 () {60 vars in 1190 bytes} [Mon May 23 16:38:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 23 16:38:32.276175 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-ede623fd-0814-4043-bea2-a569cbb09958 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:32.277210 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-ede623fd-0814-4043-bea2-a569cbb09958 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 23 16:38:32.277607 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 21/43] 10.222.0.74 () {56 vars in 1074 bytes} [Mon May 23 16:38:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:38:32.466532 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-9533f42e-8421-47a1-9882-5b0265b61b3b admin admin] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:32.472084 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.wsgi [None req-9533f42e-8421-47a1-9882-5b0265b61b3b admin admin] HTTP exception thrown: Flavor 84 could not be found. May 23 16:38:32.474033 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-9533f42e-8421-47a1-9882-5b0265b61b3b admin admin] Request method failure captured: May 23 16:38:32.474033 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 23 16:38:32.474033 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: Accept: application/json May 23 16:38:32.474033 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: Accept-Encoding: gzip, deflate May 23 16:38:32.474033 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: Connection: keep-alive May 23 16:38:32.474033 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: Content-Length: 0 May 23 16:38:32.474033 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: Host: 10.222.0.74 May 23 16:38:32.474033 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: Openstack-Api-Version: compute 2.90 May 23 16:38:32.474033 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: Openstack-System-Scope: None May 23 16:38:32.474033 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: User-Agent: python-novaclient May 23 16:38:32.474033 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Auth-Token: gAAAAABii7iIwB5ZbzsGJfDa0innYFvxcp9YEjHEnJv6-SihO1kT_E3zJxpuUFrG0zy3ZRyXxTfQaIOG8PhBnT3C5ssW1Vqe2j-Uvch3Tl1jJVXH0uwwFTFmzM7pSEDR563nUcrYFV1SjZYDJAmYPInW0Whg6-YCAPKNyp8-0NBfjAskzH3MqQM May 23 16:38:32.474033 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Domain-Id: None May 23 16:38:32.474033 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Domain-Name: None May 23 16:38:32.474033 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Identity-Status: Confirmed May 23 16:38:32.474033 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Is-Admin-Project: True May 23 16:38:32.474033 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Openstack-Nova-Api-Version: 2.90 May 23 16:38:32.474033 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Project-Domain-Id: default May 23 16:38:32.474033 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Project-Domain-Name: Default May 23 16:38:32.474033 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Project-Id: a06edcae6b7a4521b29d4cfac1cfa2c1 May 23 16:38:32.474033 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Project-Name: admin May 23 16:38:32.474033 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Role: admin,member,reader May 23 16:38:32.474033 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Roles: admin,member,reader May 23 16:38:32.475807 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:38:32.475807 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Tenant: admin May 23 16:38:32.475807 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Tenant-Id: a06edcae6b7a4521b29d4cfac1cfa2c1 May 23 16:38:32.475807 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Tenant-Name: admin May 23 16:38:32.475807 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-User: admin May 23 16:38:32.475807 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-User-Domain-Id: default May 23 16:38:32.475807 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-User-Domain-Name: Default May 23 16:38:32.475807 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-User-Id: 9f0fe22fa44447e8acda5720d7e2ffa6 May 23 16:38:32.475807 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-User-Name: admin May 23 16:38:32.475807 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: method: > May 23 16:38:32.475807 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: exception: Flavor 84 could not be found. May 23 16:38:32.475807 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: action_args: {'id': '84'} May 23 16:38:32.475807 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:38:32.475807 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:38:32.476709 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 16:38:32.476709 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 16:38:32.476709 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 16:38:32.476709 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 16:38:32.476709 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 16:38:32.476709 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 16:38:32.476709 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 16:38:32.476709 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 16:38:32.476709 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 16:38:32.476709 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:38:32.476709 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 16:38:32.476709 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 16:38:32.476709 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 23 16:38:32.476709 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi May 23 16:38:32.476709 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:38:32.476709 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi May 23 16:38:32.476709 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:38:32.476709 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:38:32.476709 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:38:32.477820 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:38:32.477820 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:38:32.477820 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:38:32.477820 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:38:32.477820 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 16:38:32.477820 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 16:38:32.477820 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 23 16:38:32.477820 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi May 23 16:38:32.477820 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:38:32.477820 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi May 23 16:38:32.477820 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:38:32.477820 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:38:32.477820 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:38:32.477820 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:38:32.477820 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:38:32.477820 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 23 16:38:32.477820 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi May 23 16:38:32.477820 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-9533f42e-8421-47a1-9882-5b0265b61b3b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:38:32.479397 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-9533f42e-8421-47a1-9882-5b0265b61b3b admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062267 May 23 16:38:32.479397 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 23/44] 10.222.0.74 () {60 vars in 1190 bytes} [Mon May 23 16:38:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 16:38:32.485035 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-be3db6e0-a275-4344-a878-87eb6ef71835 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:32.500461 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-be3db6e0-a275-4344-a878-87eb6ef71835 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018953 May 23 16:38:32.500988 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 22/45] 10.222.0.74 () {60 vars in 1210 bytes} [Mon May 23 16:38:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:38:32.510806 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-338e5c21-9125-400f-ac19-f07656c7859d admin admin] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:32.524838 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-338e5c21-9125-400f-ac19-f07656c7859d admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017490 May 23 16:38:32.529858 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 24/46] 10.222.0.74 () {60 vars in 1210 bytes} [Mon May 23 16:38:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:38:32.538397 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-08035750-2ab1-40bc-ae37-0b17a4866aba admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:32.544008 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.wsgi [None req-08035750-2ab1-40bc-ae37-0b17a4866aba admin admin] HTTP exception thrown: Flavor 84 could not be found. May 23 16:38:32.545625 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-08035750-2ab1-40bc-ae37-0b17a4866aba admin admin] Request method failure captured: May 23 16:38:32.545625 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 23 16:38:32.545625 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: Accept: application/json May 23 16:38:32.545625 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: Accept-Encoding: gzip, deflate May 23 16:38:32.545625 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: Connection: keep-alive May 23 16:38:32.545625 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: Content-Length: 0 May 23 16:38:32.545625 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: Host: 10.222.0.74 May 23 16:38:32.545625 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: Openstack-Api-Version: compute 2.90 May 23 16:38:32.545625 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: Openstack-System-Scope: None May 23 16:38:32.545625 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: User-Agent: python-novaclient May 23 16:38:32.545625 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Auth-Token: gAAAAABii7iIwB5ZbzsGJfDa0innYFvxcp9YEjHEnJv6-SihO1kT_E3zJxpuUFrG0zy3ZRyXxTfQaIOG8PhBnT3C5ssW1Vqe2j-Uvch3Tl1jJVXH0uwwFTFmzM7pSEDR563nUcrYFV1SjZYDJAmYPInW0Whg6-YCAPKNyp8-0NBfjAskzH3MqQM May 23 16:38:32.545625 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Domain-Id: None May 23 16:38:32.545625 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Domain-Name: None May 23 16:38:32.545625 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Identity-Status: Confirmed May 23 16:38:32.545625 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Is-Admin-Project: True May 23 16:38:32.545625 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Openstack-Nova-Api-Version: 2.90 May 23 16:38:32.545625 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Project-Domain-Id: default May 23 16:38:32.545625 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Project-Domain-Name: Default May 23 16:38:32.545625 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Project-Id: a06edcae6b7a4521b29d4cfac1cfa2c1 May 23 16:38:32.545625 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Project-Name: admin May 23 16:38:32.545625 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Role: admin,member,reader May 23 16:38:32.545625 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Roles: admin,member,reader May 23 16:38:32.547150 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:38:32.547150 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Tenant: admin May 23 16:38:32.547150 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Tenant-Id: a06edcae6b7a4521b29d4cfac1cfa2c1 May 23 16:38:32.547150 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Tenant-Name: admin May 23 16:38:32.547150 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-User: admin May 23 16:38:32.547150 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-User-Domain-Id: default May 23 16:38:32.547150 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-User-Domain-Name: Default May 23 16:38:32.547150 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-User-Id: 9f0fe22fa44447e8acda5720d7e2ffa6 May 23 16:38:32.547150 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-User-Name: admin May 23 16:38:32.547150 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: method: > May 23 16:38:32.547150 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: exception: Flavor 84 could not be found. May 23 16:38:32.547150 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: action_args: {'id': '84'} May 23 16:38:32.547150 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:38:32.547150 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:38:32.548064 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 16:38:32.548064 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 16:38:32.548064 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 16:38:32.548064 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 16:38:32.548064 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 16:38:32.548064 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 16:38:32.548064 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 16:38:32.548064 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 16:38:32.548064 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 16:38:32.548064 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:38:32.548064 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 16:38:32.548064 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 16:38:32.548064 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 23 16:38:32.548064 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 23 16:38:32.548064 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:38:32.548064 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 23 16:38:32.548064 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:38:32.548064 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:38:32.548064 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:38:32.549136 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:38:32.549136 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:38:32.549136 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:38:32.549136 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:38:32.549136 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 16:38:32.549136 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 16:38:32.549136 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 23 16:38:32.549136 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 23 16:38:32.549136 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:38:32.549136 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 23 16:38:32.549136 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:38:32.549136 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:38:32.549136 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:38:32.549136 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:38:32.549136 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:38:32.549136 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 23 16:38:32.549136 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 23 16:38:32.549136 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-08035750-2ab1-40bc-ae37-0b17a4866aba admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:38:32.550181 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-08035750-2ab1-40bc-ae37-0b17a4866aba admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012985 May 23 16:38:32.550181 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 23/47] 10.222.0.74 () {60 vars in 1190 bytes} [Mon May 23 16:38:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 23 16:38:33.422852 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-338e5c21-9125-400f-ac19-f07656c7859d admin admin] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:33.423846 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-338e5c21-9125-400f-ac19-f07656c7859d admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 May 23 16:38:33.424238 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 25/48] 10.222.0.74 () {56 vars in 1074 bytes} [Mon May 23 16:38:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:38:33.612596 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-3f577e6c-0a35-4b6e-917d-78fb49fbf295 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:33.618344 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.wsgi [None req-3f577e6c-0a35-4b6e-917d-78fb49fbf295 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 23 16:38:33.619844 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-3f577e6c-0a35-4b6e-917d-78fb49fbf295 admin admin] Request method failure captured: May 23 16:38:33.619844 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 23 16:38:33.619844 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: Accept: application/json May 23 16:38:33.619844 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: Accept-Encoding: gzip, deflate May 23 16:38:33.619844 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: Connection: keep-alive May 23 16:38:33.619844 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: Content-Length: 0 May 23 16:38:33.619844 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: Host: 10.222.0.74 May 23 16:38:33.619844 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: Openstack-Api-Version: compute 2.90 May 23 16:38:33.619844 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: Openstack-System-Scope: None May 23 16:38:33.619844 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: User-Agent: python-novaclient May 23 16:38:33.619844 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Auth-Token: gAAAAABii7iJSR_DlWJ-mtrFDCEqoWdi5xPHJfCnySubQCOT3gjNFmzDCJ5pWQmEJ5RoVICpcjYLXevQK0O_AxWScaGAwPntk25BCs2L4EWrCoas_h9CyRQpuFvNTFlFRFafjtoGTyeWc1i81CZQGFGLp_CfzqwLEndt8w6KY9Sjv36YKeycMc8 May 23 16:38:33.619844 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Domain-Id: None May 23 16:38:33.619844 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Domain-Name: None May 23 16:38:33.619844 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Identity-Status: Confirmed May 23 16:38:33.619844 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Is-Admin-Project: True May 23 16:38:33.619844 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Openstack-Nova-Api-Version: 2.90 May 23 16:38:33.619844 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Project-Domain-Id: default May 23 16:38:33.619844 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Project-Domain-Name: Default May 23 16:38:33.619844 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Project-Id: a06edcae6b7a4521b29d4cfac1cfa2c1 May 23 16:38:33.619844 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Project-Name: admin May 23 16:38:33.619844 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Role: admin,member,reader May 23 16:38:33.619844 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Roles: admin,member,reader May 23 16:38:33.621441 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:38:33.621441 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Tenant: admin May 23 16:38:33.621441 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Tenant-Id: a06edcae6b7a4521b29d4cfac1cfa2c1 May 23 16:38:33.621441 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-Tenant-Name: admin May 23 16:38:33.621441 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-User: admin May 23 16:38:33.621441 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-User-Domain-Id: default May 23 16:38:33.621441 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-User-Domain-Name: Default May 23 16:38:33.621441 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-User-Id: 9f0fe22fa44447e8acda5720d7e2ffa6 May 23 16:38:33.621441 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: X-User-Name: admin May 23 16:38:33.621441 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: method: > May 23 16:38:33.621441 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: exception: Flavor 451 could not be found. May 23 16:38:33.621441 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: action_args: {'id': '451'} May 23 16:38:33.621441 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:38:33.621441 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:38:33.622634 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 16:38:33.622634 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 16:38:33.622634 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 16:38:33.622634 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 16:38:33.622634 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 16:38:33.622634 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 16:38:33.622634 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 16:38:33.622634 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 16:38:33.622634 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 16:38:33.622634 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:38:33.622634 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 16:38:33.622634 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 16:38:33.622634 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 23 16:38:33.622634 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 23 16:38:33.622634 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:38:33.622634 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 23 16:38:33.622634 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:38:33.622634 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:38:33.622634 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:38:33.623998 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:38:33.623998 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:38:33.623998 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:38:33.623998 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:38:33.623998 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 16:38:33.623998 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 16:38:33.623998 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 23 16:38:33.623998 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 23 16:38:33.623998 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:38:33.623998 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 23 16:38:33.623998 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:38:33.623998 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:38:33.623998 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:38:33.623998 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:38:33.623998 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:38:33.623998 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 23 16:38:33.623998 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 23 16:38:33.623998 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-3f577e6c-0a35-4b6e-917d-78fb49fbf295 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:38:33.625280 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-3f577e6c-0a35-4b6e-917d-78fb49fbf295 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059832 May 23 16:38:33.625280 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 24/49] 10.222.0.74 () {60 vars in 1193 bytes} [Mon May 23 16:38:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 16:38:33.631971 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-5ad7cf5b-687e-471f-8566-0ae4bd16710f admin admin] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:33.647792 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-5ad7cf5b-687e-471f-8566-0ae4bd16710f admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020460 May 23 16:38:33.648341 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 26/50] 10.222.0.74 () {60 vars in 1210 bytes} [Mon May 23 16:38:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:38:33.657982 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-ada214ff-67d1-478b-aef5-7aec06632bfc admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:33.671293 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-ada214ff-67d1-478b-aef5-7aec06632bfc admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016993 May 23 16:38:33.671828 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 25/51] 10.222.0.74 () {60 vars in 1210 bytes} [Mon May 23 16:38:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:38:33.680985 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-20157bd9-6b17-438d-bb94-dfba7a2497dd admin admin] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:33.686360 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.wsgi [None req-20157bd9-6b17-438d-bb94-dfba7a2497dd admin admin] HTTP exception thrown: Flavor 451 could not be found. May 23 16:38:33.687834 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-20157bd9-6b17-438d-bb94-dfba7a2497dd admin admin] Request method failure captured: May 23 16:38:33.687834 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 23 16:38:33.687834 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: Accept: application/json May 23 16:38:33.687834 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: Accept-Encoding: gzip, deflate May 23 16:38:33.687834 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: Connection: keep-alive May 23 16:38:33.687834 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: Content-Length: 0 May 23 16:38:33.687834 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: Host: 10.222.0.74 May 23 16:38:33.687834 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: Openstack-Api-Version: compute 2.90 May 23 16:38:33.687834 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: Openstack-System-Scope: None May 23 16:38:33.687834 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: User-Agent: python-novaclient May 23 16:38:33.687834 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Auth-Token: gAAAAABii7iJSR_DlWJ-mtrFDCEqoWdi5xPHJfCnySubQCOT3gjNFmzDCJ5pWQmEJ5RoVICpcjYLXevQK0O_AxWScaGAwPntk25BCs2L4EWrCoas_h9CyRQpuFvNTFlFRFafjtoGTyeWc1i81CZQGFGLp_CfzqwLEndt8w6KY9Sjv36YKeycMc8 May 23 16:38:33.687834 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Domain-Id: None May 23 16:38:33.687834 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Domain-Name: None May 23 16:38:33.687834 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Identity-Status: Confirmed May 23 16:38:33.687834 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Is-Admin-Project: True May 23 16:38:33.687834 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Openstack-Nova-Api-Version: 2.90 May 23 16:38:33.687834 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Project-Domain-Id: default May 23 16:38:33.687834 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Project-Domain-Name: Default May 23 16:38:33.687834 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Project-Id: a06edcae6b7a4521b29d4cfac1cfa2c1 May 23 16:38:33.687834 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Project-Name: admin May 23 16:38:33.687834 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Role: admin,member,reader May 23 16:38:33.687834 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Roles: admin,member,reader May 23 16:38:33.689528 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_a06edcae6b7a4521b29d4cfac1cfa2c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:38:33.689528 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Tenant: admin May 23 16:38:33.689528 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Tenant-Id: a06edcae6b7a4521b29d4cfac1cfa2c1 May 23 16:38:33.689528 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-Tenant-Name: admin May 23 16:38:33.689528 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-User: admin May 23 16:38:33.689528 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-User-Domain-Id: default May 23 16:38:33.689528 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-User-Domain-Name: Default May 23 16:38:33.689528 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-User-Id: 9f0fe22fa44447e8acda5720d7e2ffa6 May 23 16:38:33.689528 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: X-User-Name: admin May 23 16:38:33.689528 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: method: > May 23 16:38:33.689528 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: exception: Flavor 451 could not be found. May 23 16:38:33.689528 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: action_args: {'id': '451'} May 23 16:38:33.689528 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:38:33.689528 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:38:33.690545 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 16:38:33.690545 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 16:38:33.690545 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 16:38:33.690545 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 16:38:33.690545 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 16:38:33.690545 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 16:38:33.690545 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 16:38:33.690545 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 16:38:33.690545 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 16:38:33.690545 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:38:33.690545 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 16:38:33.690545 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 16:38:33.690545 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 23 16:38:33.690545 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi May 23 16:38:33.690545 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:38:33.690545 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi May 23 16:38:33.690545 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:38:33.690545 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:38:33.690545 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:38:33.691705 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:38:33.691705 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:38:33.691705 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:38:33.691705 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:38:33.691705 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 16:38:33.691705 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 16:38:33.691705 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 23 16:38:33.691705 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi May 23 16:38:33.691705 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:38:33.691705 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi May 23 16:38:33.691705 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:38:33.691705 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:38:33.691705 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:38:33.691705 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:38:33.691705 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:38:33.691705 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 23 16:38:33.691705 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: ERROR nova.api.openstack.wsgi May 23 16:38:33.691705 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-20157bd9-6b17-438d-bb94-dfba7a2497dd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:38:33.693524 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-20157bd9-6b17-438d-bb94-dfba7a2497dd admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011713 May 23 16:38:33.693524 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 27/52] 10.222.0.74 () {60 vars in 1193 bytes} [Mon May 23 16:38:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 16:38:34.621926 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-ada214ff-67d1-478b-aef5-7aec06632bfc admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:34.629963 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-ada214ff-67d1-478b-aef5-7aec06632bfc admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 23 16:38:34.629963 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 26/53] 10.222.0.74 () {56 vars in 1074 bytes} [Mon May 23 16:38:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:38:34.814402 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-c2b705e9-2001-4a49-9e86-126ac03dd0c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:38:34.910598 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-c2b705e9-2001-4a49-9e86-126ac03dd0c7 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.148577 May 23 16:38:34.911528 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 28/54] 10.222.0.74 () {64 vars in 1235 bytes} [Mon May 23 16:38:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 16:38:35.786587 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-ada214ff-67d1-478b-aef5-7aec06632bfc admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:35.787584 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-ada214ff-67d1-478b-aef5-7aec06632bfc admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 May 23 16:38:35.787982 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 27/55] 10.222.0.74 () {56 vars in 1074 bytes} [Mon May 23 16:38:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:38:35.976624 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-e428a8a4-0664-42d1-b57a-bc529ae5b014 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:38:36.111001 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-e428a8a4-0664-42d1-b57a-bc529ae5b014 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.185767 May 23 16:38:36.111555 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 29/56] 10.222.0.74 () {64 vars in 1235 bytes} [Mon May 23 16:38:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 16:38:36.977141 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-ada214ff-67d1-478b-aef5-7aec06632bfc admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:36.978406 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-ada214ff-67d1-478b-aef5-7aec06632bfc admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 May 23 16:38:36.978836 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 28/57] 10.222.0.74 () {56 vars in 1074 bytes} [Mon May 23 16:38:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:38:37.165338 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-98a3f530-9c6d-4ac4-b282-8b7693f962b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:38:37.236462 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-98a3f530-9c6d-4ac4-b282-8b7693f962b2 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.122565 May 23 16:38:37.237015 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 30/58] 10.222.0.74 () {64 vars in 1235 bytes} [Mon May 23 16:38:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 16:38:38.109337 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-ada214ff-67d1-478b-aef5-7aec06632bfc admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:38.110337 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-ada214ff-67d1-478b-aef5-7aec06632bfc admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 May 23 16:38:38.110732 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 29/59] 10.222.0.74 () {56 vars in 1074 bytes} [Mon May 23 16:38:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:38:38.301861 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-f05acace-09ee-43dc-8c3e-a9ddb8f548e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:38:38.413652 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-f05acace-09ee-43dc-8c3e-a9ddb8f548e6 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.166648 May 23 16:38:38.414165 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 31/60] 10.222.0.74 () {64 vars in 1235 bytes} [Mon May 23 16:38:38 2022] POST /compute/v2.1/flavors => generated 409 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 16:38:39.298381 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-ada214ff-67d1-478b-aef5-7aec06632bfc admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:39.299442 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-ada214ff-67d1-478b-aef5-7aec06632bfc admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 23 16:38:39.299820 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 30/61] 10.222.0.74 () {56 vars in 1074 bytes} [Mon May 23 16:38:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:38:39.490524 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-e83bd774-f2a3-4da5-a7b1-edf32095bf51 admin admin] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:38:39.509822 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-e83bd774-f2a3-4da5-a7b1-edf32095bf51 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072704 May 23 16:38:39.510350 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 32/62] 10.222.0.74 () {60 vars in 1202 bytes} [Mon May 23 16:38:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:39:42.362747 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-ada214ff-67d1-478b-aef5-7aec06632bfc admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:39:42.363742 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-ada214ff-67d1-478b-aef5-7aec06632bfc admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 May 23 16:39:42.364132 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 31/63] 10.222.0.74 () {54 vars in 930 bytes} [Mon May 23 16:39:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:39:42.371573 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG dbcounter [-] [110286] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:39:42.422852 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-61ed6a61-9878-4234-9f9d-23bfa53ca2d4 admin admin] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:39:42.442144 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-61ed6a61-9878-4234-9f9d-23bfa53ca2d4 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071964 May 23 16:39:42.442677 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 33/64] 10.222.0.74 () {60 vars in 1291 bytes} [Mon May 23 16:39:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:39:42.463058 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG dbcounter [-] [110285] Writing DB stats nova_api:SELECT=14 {{(pid=110285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:39:42.466726 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-730dd1e4-ec0b-456b-a9b1-848bfa80b843 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:39:42.475254 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-730dd1e4-ec0b-456b-a9b1-848bfa80b843 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013682 May 23 16:39:42.475766 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 32/65] 10.222.0.74 () {60 vars in 1282 bytes} [Mon May 23 16:39:42 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:39:42.488198 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-5a521bda-5e4e-4cb0-8ccf-f4fb8fabd9a6 admin admin] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:39:42.496060 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-5a521bda-5e4e-4cb0-8ccf-f4fb8fabd9a6 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012622 May 23 16:39:42.496677 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 34/66] 10.222.0.74 () {60 vars in 1285 bytes} [Mon May 23 16:39:42 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:39:42.507824 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-42f41f84-04ef-487d-af21-6ec0bb3c78c2 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:39:42.515665 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-42f41f84-04ef-487d-af21-6ec0bb3c78c2 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011333 May 23 16:39:42.516345 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 33/67] 10.222.0.74 () {60 vars in 1285 bytes} [Mon May 23 16:39:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:39:42.528932 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-264aeb53-3448-46ff-9475-97a346f3db2e admin admin] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:39:42.537653 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-264aeb53-3448-46ff-9475-97a346f3db2e admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012443 May 23 16:39:42.538210 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 35/68] 10.222.0.74 () {60 vars in 1282 bytes} [Mon May 23 16:39:42 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:43:25.203483 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-42f41f84-04ef-487d-af21-6ec0bb3c78c2 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:43:25.204529 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-42f41f84-04ef-487d-af21-6ec0bb3c78c2 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 May 23 16:43:25.204950 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 34/69] 10.222.0.74 () {56 vars in 1074 bytes} [Mon May 23 16:43:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:43:25.363870 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG dbcounter [-] [110286] Writing DB stats nova_api:SELECT=6 {{(pid=110286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:43:25.476806 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-51236b13-e4db-41fe-ae45-bb9ce7cfe9f4 admin admin] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:43:25.478046 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 16:43:25.478046 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: warnings.warn(msg) May 23 16:43:25.479222 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_concurrency.lockutils [None req-51236b13-e4db-41fe-ae45-bb9ce7cfe9f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:43:25.479651 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_concurrency.lockutils [None req-51236b13-e4db-41fe-ae45-bb9ce7cfe9f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:43:25.480446 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_concurrency.lockutils [None req-51236b13-e4db-41fe-ae45-bb9ce7cfe9f4 admin admin] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:43:25.480865 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_concurrency.lockutils [None req-51236b13-e4db-41fe-ae45-bb9ce7cfe9f4 admin admin] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:43:25.515197 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-51236b13-e4db-41fe-ae45-bb9ce7cfe9f4 admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.153372 May 23 16:43:25.515767 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 36/70] 10.222.0.74 () {60 vars in 1193 bytes} [Mon May 23 16:43:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 16:43:26.443768 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-42f41f84-04ef-487d-af21-6ec0bb3c78c2 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:43:26.444863 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-42f41f84-04ef-487d-af21-6ec0bb3c78c2 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 23 16:43:26.445256 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 35/71] 10.222.0.74 () {56 vars in 1074 bytes} [Mon May 23 16:43:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:43:26.637629 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-5f428416-86cc-4ff5-a0d3-2ca0e4da285f admin admin] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:43:26.638895 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 16:43:26.638895 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: warnings.warn(msg) May 23 16:43:26.640071 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_concurrency.lockutils [None req-5f428416-86cc-4ff5-a0d3-2ca0e4da285f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:43:26.640540 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_concurrency.lockutils [None req-5f428416-86cc-4ff5-a0d3-2ca0e4da285f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:43:26.641319 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_concurrency.lockutils [None req-5f428416-86cc-4ff5-a0d3-2ca0e4da285f admin admin] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:43:26.641747 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_concurrency.lockutils [None req-5f428416-86cc-4ff5-a0d3-2ca0e4da285f admin admin] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:43:26.661177 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-5f428416-86cc-4ff5-a0d3-2ca0e4da285f admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076022 May 23 16:43:26.661731 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 37/72] 10.222.0.74 () {60 vars in 1193 bytes} [Mon May 23 16:43:26 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 16:43:37.972433 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-42f41f84-04ef-487d-af21-6ec0bb3c78c2 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:43:37.973501 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-42f41f84-04ef-487d-af21-6ec0bb3c78c2 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 May 23 16:43:37.973897 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 36/73] 10.222.0.74 () {56 vars in 1074 bytes} [Mon May 23 16:43:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:43:38.116125 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG dbcounter [-] [110286] Writing DB stats nova_cell0:SELECT=4 {{(pid=110286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:43:38.116870 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG dbcounter [-] [110286] Writing DB stats nova_cell1:SELECT=4 {{(pid=110286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:43:38.117473 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG dbcounter [-] [110286] Writing DB stats nova_api:SELECT=8 {{(pid=110286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:43:38.167249 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-df755819-e09c-45dd-9b60-57acf13a4f48 admin admin] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:43:38.168448 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 16:43:38.168448 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: warnings.warn(msg) May 23 16:43:38.169620 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_concurrency.lockutils [None req-df755819-e09c-45dd-9b60-57acf13a4f48 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:43:38.170105 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_concurrency.lockutils [None req-df755819-e09c-45dd-9b60-57acf13a4f48 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:43:38.170870 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_concurrency.lockutils [None req-df755819-e09c-45dd-9b60-57acf13a4f48 admin admin] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:43:38.171318 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_concurrency.lockutils [None req-df755819-e09c-45dd-9b60-57acf13a4f48 admin admin] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:43:38.196132 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-df755819-e09c-45dd-9b60-57acf13a4f48 admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084382 May 23 16:43:38.198429 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 38/74] 10.222.0.74 () {60 vars in 1193 bytes} [Mon May 23 16:43:38 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:43:39.078573 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-42f41f84-04ef-487d-af21-6ec0bb3c78c2 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:43:39.079594 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-42f41f84-04ef-487d-af21-6ec0bb3c78c2 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 23 16:43:39.079998 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 37/75] 10.222.0.74 () {56 vars in 1074 bytes} [Mon May 23 16:43:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:43:39.270901 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG nova.api.openstack.wsgi [None req-5e6cfc68-ee0c-46ca-bcaa-99deaa465a49 admin admin] Calling method '>' {{(pid=110286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:43:39.272070 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 16:43:39.272070 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: warnings.warn(msg) May 23 16:43:39.273280 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_concurrency.lockutils [None req-5e6cfc68-ee0c-46ca-bcaa-99deaa465a49 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:43:39.273709 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_concurrency.lockutils [None req-5e6cfc68-ee0c-46ca-bcaa-99deaa465a49 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:43:39.274483 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_concurrency.lockutils [None req-5e6cfc68-ee0c-46ca-bcaa-99deaa465a49 admin admin] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:43:39.274960 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: DEBUG oslo_concurrency.lockutils [None req-5e6cfc68-ee0c-46ca-bcaa-99deaa465a49 admin admin] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:43:39.297115 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: INFO nova.api.openstack.requestlog [None req-5e6cfc68-ee0c-46ca-bcaa-99deaa465a49 admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078357 May 23 16:43:39.297682 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: [pid: 110286|app: 0|req: 39/76] 10.222.0.74 () {60 vars in 1193 bytes} [Mon May 23 16:43:39 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:44:36.853033 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: Mon May 23 16:44:36 2022 - graceful shutdown triggered... May 23 16:44:36.853595 dv-cinder-839257-3-iscsi devstack@n-api.service[110285]: Gracefully killing worker 1 (pid: 110285)... May 23 16:44:36.853276 dv-cinder-839257-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 23 16:44:36.854487 dv-cinder-839257-3-iscsi devstack@n-api.service[110286]: Gracefully killing worker 2 (pid: 110286)... May 23 16:44:37.854162 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: worker 1 buried after 1 seconds May 23 16:44:37.854162 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: worker 2 buried after 1 seconds May 23 16:44:37.854162 dv-cinder-839257-3-iscsi devstack@n-api.service[110284]: goodbye to uWSGI. May 23 16:44:37.855775 dv-cinder-839257-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 23 16:44:37.856409 dv-cinder-839257-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 23 16:44:37.859158 dv-cinder-839257-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 23 16:44:37.875929 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 23 16:44:37.900077 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 16:44:37 2022] *** May 23 16:44:37.900077 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 16:44:37.900077 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 16:44:37.900077 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: nodename: dv-cinder-839257-3-iscsi May 23 16:44:37.900077 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: machine: x86_64 May 23 16:44:37.900077 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: clock source: unix May 23 16:44:37.900077 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: pcre jit disabled May 23 16:44:37.900077 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: detected number of CPU cores: 4 May 23 16:44:37.900077 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: current working directory: / May 23 16:44:37.900077 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: detected binary path: /usr/bin/uwsgi-core May 23 16:44:37.900077 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: your processes number limit is 47680 May 23 16:44:37.900077 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: your memory page size is 4096 bytes May 23 16:44:37.900077 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: detected max file descriptor number: 2048 May 23 16:44:37.900077 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: lock engine: pthread robust mutexes May 23 16:44:37.901185 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: thunder lock: enabled May 23 16:44:37.901185 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 23 16:44:37.901185 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 16:44:37.949521 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: Python main interpreter initialized at 0x559e876fc9c0 May 23 16:44:37.949521 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: python threads support enabled May 23 16:44:37.949521 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: your server socket listen backlog is limited to 100 connections May 23 16:44:37.949521 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: your mercy for graceful operations on workers is 90 seconds May 23 16:44:37.949975 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: mapped 403077 bytes (393 KB) for 2 cores May 23 16:44:37.949975 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: *** Operational MODE: preforking *** May 23 16:44:37.950232 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: *** uWSGI is running in multiple interpreter mode *** May 23 16:44:37.950232 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: spawned uWSGI master process (pid: 124695) May 23 16:44:37.950446 dv-cinder-839257-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 23 16:44:37.953761 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: spawned uWSGI worker 1 (pid: 124714, cores: 1) May 23 16:44:37.953761 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: spawned uWSGI worker 2 (pid: 124715, cores: 1) May 23 16:44:37.953761 dv-cinder-839257-3-iscsi devstack@n-api.service[124695]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 16:44:39.140970 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 16:44:39.143671 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 16:44:39.930818 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 16:44:39.930818 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: from cryptography.utils import int_from_bytes May 23 16:44:39.931169 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 16:44:39.931169 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: from cryptography.utils import int_from_bytes May 23 16:44:39.936171 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 16:44:39.936171 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: from cryptography.utils import int_from_bytes May 23 16:44:39.936621 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 16:44:39.936621 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: from cryptography.utils import int_from_bytes May 23 16:44:42.393879 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 16:44:42.394443 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 16:44:42.394724 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 16:44:42.394944 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 16:44:42.395206 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 16:44:42.395601 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.395932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.396258 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.396605 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.396744 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 16:44:42.397103 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 16:44:42.397183 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.397267 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.397458 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 16:44:42.397571 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.397804 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 16:44:42.397906 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.398063 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 16:44:42.398225 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.398441 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.398553 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.398762 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.398866 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.399092 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839257-3-iscsi {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.399215 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.399451 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.399556 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.399724 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.399833 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.400039 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.400150 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.400394 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.400509 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.400692 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.400858 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.401013 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.401161 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.401317 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.401473 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.401627 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.401780 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.401951 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839257-3-iscsi {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.402523 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.402840 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.403251 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.403497 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.403725 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.403938 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.404162 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.404389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.404389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.405379 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.405598 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.405820 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.406026 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.406258 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.406464 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.406686 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.406904 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.407128 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.407362 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839257-3-iscsi {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.407578 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.407791 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.408012 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.408224 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.408474 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.408726 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.408913 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.409089 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.409285 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.409439 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.409598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.409801 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.409955 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.410107 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.410259 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.410440 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.410593 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.410756 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.410912 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.411342 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.411512 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839257-3-iscsi {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.411667 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.411849 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.412012 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.412190 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.412435 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.412611 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.412761 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.412761 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.413049 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.413205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.413359 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.413502 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.413646 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.413794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.413946 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.414101 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.414256 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.414471 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.414626 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.414775 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.414931 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.415088 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.415253 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.415404 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.415547 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.415702 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.415855 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.416012 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.416012 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.416336 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.416488 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.416642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.416800 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.416967 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.417111 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.417259 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.417408 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.417549 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.417703 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.417854 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.417854 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.418134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.418772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.418943 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.418943 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.419236 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.419396 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.419547 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.419700 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.419853 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.420006 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.420159 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.420159 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.421563 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.421722 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.421888 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.422035 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.422199 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.422348 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.422500 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.422657 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.422812 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.422962 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.423114 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.423259 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.423411 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.423567 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.423717 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.423866 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.423866 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.423866 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.423866 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.423866 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.423866 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.424728 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.424872 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.425014 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.425163 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.425320 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.425320 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.425597 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.425746 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.425895 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.426060 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.426213 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.426366 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.426508 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.426657 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.426806 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.426961 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.427114 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.427265 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.427407 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.427548 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.427548 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.427849 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.428001 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.428151 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.428370 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.429025 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.429189 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.429355 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.429507 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.429651 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.429801 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.429951 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.430111 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.430256 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.430410 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.430553 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.430553 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.430844 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.430844 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.431125 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.431554 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.431814 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.431969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.432119 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.432494 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.432650 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.432805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.432966 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.433110 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.433259 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.433411 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.433563 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.433706 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.433849 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.433999 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.434142 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.434300 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.434444 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.434593 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.434736 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.434898 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.435056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.435205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.435354 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.435509 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.435654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.435810 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.435977 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.436122 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.436271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.436464 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.436610 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.436754 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.436908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.437153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.440272 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.440518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.440674 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.440832 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.440991 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.441141 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.441293 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.441683 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.441952 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.442104 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.442271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.442486 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.442486 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.442772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.442923 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.443067 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.443223 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.443377 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.443520 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.443520 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.443797 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.443954 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.444105 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.444267 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.444510 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.444661 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.444803 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.444958 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.445109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.445258 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.445409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.445552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.445695 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.445846 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.445996 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.446148 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.446301 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.446453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.446596 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.446752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.446903 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.447046 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.447198 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.447341 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.447493 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.447647 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.447791 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.447933 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.448086 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.448246 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.448451 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.448603 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.448762 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.448915 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.449059 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.449059 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.449352 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.449496 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.449638 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.449788 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.450343 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.450513 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 16:44:42.450674 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.450674 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.450968 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.451118 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.451267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.451428 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.451814 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.451985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.452232 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.452415 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.452567 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.452727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.452890 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.453042 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.453191 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.453896 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.454061 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.454220 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.454364 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.454517 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.454674 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.454827 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.454980 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.455131 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.455299 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.455450 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.455596 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.455749 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.455900 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.456051 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.456202 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.456375 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.456537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.456681 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.456839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.456995 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.457146 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.457309 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.457459 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.457611 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.458011 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.458172 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.458316 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.458458 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.458601 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.458757 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.458912 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.459064 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.459218 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.459369 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.459528 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.459681 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.459833 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.459986 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.460536 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.460704 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.460704 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.460996 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.461153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.461304 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.461453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.461596 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.461770 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.462125 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.462283 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.462427 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.462577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.462728 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.462898 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.463127 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.463359 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.463516 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.463660 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.463803 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.463947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.464101 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.464264 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.464477 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.464630 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.464773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.464924 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.465078 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.465228 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.465371 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.465521 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.465664 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.465814 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.465969 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.466135 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.466286 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.466428 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.466580 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.466734 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.466890 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.467042 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.467725 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.467878 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.468021 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.468227 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.468414 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.468560 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.468721 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.468875 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.469025 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.469183 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.469334 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.469485 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.469628 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.469778 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.469921 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.470077 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.470229 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.470726 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.470885 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.471041 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.471227 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.471385 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.471537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.471688 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.471838 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.472182 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.472360 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.472537 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.472807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.472956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.473133 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.473373 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.473540 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.473693 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.473842 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.473986 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.474137 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.474287 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.474446 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.474597 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.474597 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.474886 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.475031 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.475174 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.475174 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.475474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.475625 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.475769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.475948 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.476102 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.476259 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.476448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.476448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.476732 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.476882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.477038 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.477182 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.477344 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.477488 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.477639 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.477782 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.477938 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.478081 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.478241 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.478385 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.478528 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.478687 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.478842 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.478991 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.479144 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.479294 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.479294 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.479572 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.479726 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.479879 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.480022 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.480164 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.480325 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.480853 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.481009 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.481161 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.481314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.481476 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.481620 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.481778 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.481928 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.482275 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.482433 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.482585 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.483615 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.483811 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.484025 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.484183 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.484366 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.484518 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.484674 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.484674 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.484968 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.485118 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.485271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.485421 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.485572 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.485740 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.485946 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.486095 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.486238 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.486381 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.486538 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.486692 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.486835 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.486979 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.486979 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.487264 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.487415 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.487558 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.487700 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.487842 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.487985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.488128 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.488282 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.488472 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.488627 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.488784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.488938 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.488938 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.489225 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.489376 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.489526 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.489669 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.489821 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.489973 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.490124 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.490267 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.490433 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.490584 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.491090 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.491252 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.491397 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.491541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.491683 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.491825 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.491975 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.492128 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.492553 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.492714 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.492860 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.493017 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.493160 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.493317 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.493462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.493776 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.493933 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.494084 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.494238 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.494389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.494539 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.494689 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.494909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.495076 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.495076 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.495455 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.495606 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.495606 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.495894 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.496037 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.496189 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.496359 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.496524 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.496816 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.496988 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.497134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.497286 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.497441 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.497591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.497739 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.497889 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.498040 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.498191 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.498391 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.498644 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.498860 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.499022 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.499181 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.499338 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.499488 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.499652 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.499808 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.499965 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.500123 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.500274 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.500497 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.500648 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.500828 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.501342 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.501505 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.501666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.501825 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.501987 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.502144 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.502294 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.502601 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.502601 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.502895 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.503044 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.503193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.503355 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.503505 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.503678 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.503993 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.504149 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.504149 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.504506 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.504658 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.504817 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.504966 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.505124 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.505274 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.505431 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.505587 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.505736 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.505885 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.506041 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.506190 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.506369 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.506528 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.506685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.506842 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.506999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.507161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.507311 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.507466 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.507615 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.507772 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.507929 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.508091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.508241 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.508494 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.508653 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.508817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.508970 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.509134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.509284 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.509434 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.509582 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.509738 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.509887 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.510050 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.510211 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.510368 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.510529 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.510685 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.510847 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.511016 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.511528 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.511687 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.511837 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.511986 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.512150 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.512473 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.512790 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.512946 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.513115 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.513275 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.513438 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.513588 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.513746 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.514588 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.514752 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.514752 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.515060 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.515211 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.515369 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.515525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.515675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.515849 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.516000 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.516165 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.516480 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.516647 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.516805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.516968 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.517126 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.517283 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.517440 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.517611 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.517775 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.517938 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.518108 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.518265 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.518427 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.518583 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.518733 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.518892 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.519050 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.519200 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.519357 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.519508 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.519657 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.519813 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.519978 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.520128 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.520286 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.520465 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.520616 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.520777 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.520934 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.520934 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.521675 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.521835 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.521994 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.522144 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.522144 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.522461 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.522614 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.522904 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.523060 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.523217 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.523376 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.523535 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.523693 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.523843 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.524001 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.524158 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.524358 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.524528 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.524868 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.525033 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.525185 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.525355 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.525508 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.525658 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.525809 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.526557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.526783 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.526951 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.527111 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.527274 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.527425 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.527574 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.527989 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.527989 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.528398 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.528559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.528710 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.528876 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.529030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.529180 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.529338 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.529487 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.529713 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.530372 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.530532 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.530682 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.530846 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.531005 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.531162 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.531312 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.531735 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.532023 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.532353 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.532622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.532966 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.533143 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.533295 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.533454 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.533611 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.533761 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.533761 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.534045 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.534045 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.534352 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.534503 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.534653 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.534653 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.535161 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.535323 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.535488 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.535647 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.535804 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.535963 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.536120 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.536278 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.536505 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.536658 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.536907 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.537063 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.537214 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.537454 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.537614 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.537765 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.537922 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.538181 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.538347 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.538512 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.538664 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.538821 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.538974 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.539124 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.539281 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.539446 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.539889 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.540057 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.540057 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.540402 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.540575 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.540726 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.541261 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.541427 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.541606 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.541953 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.542115 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.542371 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.542530 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.542691 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.542850 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.543171 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.543342 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.543506 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.543673 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.543831 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.543982 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.544131 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.544290 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.544533 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.544684 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.544847 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.545025 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.545516 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.545707 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.545860 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.546010 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.546160 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.546317 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.546483 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.546633 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.546785 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.547019 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.547019 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.547332 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.547493 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.547493 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.547789 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.547945 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.548095 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.548255 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.548440 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.548599 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.548756 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.548925 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.549077 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.549236 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.549405 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.549556 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.549705 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.549854 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.550004 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.550162 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.550320 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.550476 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.550632 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.550789 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.550947 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.550947 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.551248 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.551248 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.551551 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.551700 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.552080 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.552242 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.552432 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.552585 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.552745 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.552903 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.553087 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.553381 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.553538 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.553696 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.553857 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.554008 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.554168 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.554318 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.554467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.554617 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.554766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.554924 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.555083 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.555332 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.555570 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.555734 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.555903 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.556053 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.556213 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.556397 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.556550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.556700 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.556857 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.557031 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.557259 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.557423 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.557574 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.557724 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.557874 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.558049 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.558207 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.558359 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.558519 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.558676 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.558831 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.559000 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.559150 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.559300 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.559457 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.559614 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.559614 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.559923 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.560086 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.560236 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.560516 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.560677 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.560851 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.561022 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.561174 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.561324 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.561474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.561630 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.561794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.562080 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.562246 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.562408 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.562567 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.562724 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.562883 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.563040 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.563190 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.563480 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.563645 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.563802 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.563963 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.564120 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.564271 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.564464 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.564632 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.564783 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.564942 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.565100 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.565251 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.565482 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.565742 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.565908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.566060 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.566217 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.566367 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.566526 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.566696 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.566861 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.567012 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.567162 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.567392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.567549 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.567709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.567874 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.568032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.568189 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.568368 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.568532 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.568684 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.568862 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.569018 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.569176 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.569328 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.569477 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.569712 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.569865 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.570015 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.570178 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.570380 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.570536 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.570695 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.570854 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.571023 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.571180 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.571180 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.571542 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.571706 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.571864 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.572151 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.572360 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.572571 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.572735 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.572896 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.573049 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.573217 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.573368 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.573673 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.573835 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.573987 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.574137 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.574294 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.574451 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.574609 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.574789 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.575436 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.575686 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.575843 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.576041 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.576205 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.576395 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.576395 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.577330 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.577570 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.577733 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.577891 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.578055 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.578207 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.578357 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.578508 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.578665 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.578836 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.578995 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.579146 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.579305 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.579471 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.579626 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.579626 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.579926 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.580085 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.580241 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.580446 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.580612 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.580781 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.580931 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.581088 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.581244 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.581244 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.581552 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.581710 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.581867 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.582025 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.582308 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.582475 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.582636 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.583047 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.583047 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.583354 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.583644 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.583825 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.583977 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.584127 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.584284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.584460 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.584623 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.584780 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.584936 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.585093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.585243 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.585403 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.585573 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.585813 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.585976 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.586128 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.586278 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.586435 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.586596 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.586747 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.586896 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.587047 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.587213 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.587447 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.587706 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.587870 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.588021 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.588178 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.588346 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.588346 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.588671 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.588829 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.588978 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.589143 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.589304 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.589474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.589636 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.589796 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.589954 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.590104 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.590262 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.590425 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.590575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.590724 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.590874 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.591023 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.591172 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.591333 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.591485 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.591651 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.591809 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.591967 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.592769 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.592944 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.593220 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.593382 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.593533 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.593837 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.594008 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.594168 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.594320 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.594471 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.594648 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.594806 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.595033 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.595203 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.595203 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.595523 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.595681 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.595851 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.596084 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.596247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.596498 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.596661 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.596829 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.597133 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.597313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.597485 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.597736 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.597965 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.598129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.598290 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.598440 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.598590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.598739 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.598890 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.599046 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.599229 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.599380 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.599539 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.599697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.599855 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.600014 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.600183 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.600364 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.600539 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.600697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.600848 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.601010 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.601160 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.601321 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.601471 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.601628 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.601779 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.601938 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.602096 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.602253 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.602410 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.602562 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.603293 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.603471 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.603624 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.603928 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.604098 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.604250 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.604424 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.604591 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.604743 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.604899 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.605057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.605214 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.605373 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.605525 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.605674 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.605830 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.605998 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.606236 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.606408 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.606408 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.606703 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.606861 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.607017 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.607168 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.607331 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.607489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.607640 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.607986 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.608215 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.608424 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.608554 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.608655 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.608747 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.608843 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.608939 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.609037 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.609132 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.609227 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.609322 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.609416 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.609510 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.609606 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.609699 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.609793 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.609879 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.609973 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.610065 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.610161 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.610248 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.610341 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.610428 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.610513 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.610606 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.610694 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.610787 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.610874 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.610965 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.611058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.611153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.611242 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.611329 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.611414 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.611499 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.611590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.611689 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.611777 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.611869 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.611955 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.612040 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.612134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.612220 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.612321 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.612402 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.612484 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.612558 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.612651 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.612734 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.612815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.612890 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.612995 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.613094 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.613094 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.613248 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.613323 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.613394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.613394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.613534 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.613609 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.613682 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.613782 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.613860 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.613933 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.614014 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.614090 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.614169 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.614249 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.614329 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.614403 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.614489 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.614564 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.614637 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.614709 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.614781 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.614859 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.614945 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.615035 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.615117 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.615191 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.615271 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.615363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.615439 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.615519 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.615599 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.615680 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.615754 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.615836 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.615917 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.615991 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.616073 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.616153 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.616239 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.616389 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.616484 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.616568 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.616650 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.616723 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.616805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.616885 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.616966 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.617046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.617120 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.617198 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.617294 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.617386 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.617467 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.617542 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.617621 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.617764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.617842 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.617923 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.618003 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.618084 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.618084 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.618230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.618230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.618377 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.618458 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.618532 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.618609 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.618692 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.618772 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.618853 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.618934 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.619020 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.619095 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.619176 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.619258 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.619331 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.619403 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.619403 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.619621 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.619740 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.619844 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.619940 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.620027 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.620113 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.620212 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.620212 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.620443 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.620443 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.620443 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.620443 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.620759 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.620846 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.620939 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.621025 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.621110 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.621209 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.621305 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.621399 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.621492 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.621578 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.621662 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.621755 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.621849 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.621942 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.622029 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.622114 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.622198 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.622292 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.622379 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.622464 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.622548 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.622632 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.622716 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.622821 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.622821 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.623056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.623184 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.623333 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.623457 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.623582 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.623701 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.623796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.624024 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.624121 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.624218 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.624380 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.624473 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.624573 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.624675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.624764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.624859 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.624946 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.625039 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.625126 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.625219 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.625314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.625411 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.625506 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.625876 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.625973 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.625973 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.626138 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.626238 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.626332 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.626472 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.626563 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.626649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.626745 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.626839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.626926 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.627010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.627094 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.627185 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.627284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.627379 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.627474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.627562 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.627648 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.627733 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.627827 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.627914 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.628007 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.628093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.628185 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.628279 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.628440 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.628530 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.628624 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.628723 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.628809 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.628905 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.628992 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.629085 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.629179 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.629179 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.629344 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.629443 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.629530 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.629617 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.629698 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.629698 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.629837 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.629923 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.629998 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.630071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.630152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.630233 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.630332 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.630420 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.630512 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.630598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.630691 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.630784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.630879 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.630966 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.631052 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.631144 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.631231 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.631316 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.631414 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.631503 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.631589 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.631674 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.631767 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.631860 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.631955 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.631955 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.632113 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.632200 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.632284 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.632414 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.632503 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.632598 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.632733 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.632837 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.632926 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.633026 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.633120 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.633216 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.633310 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.633405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.633492 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.633587 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.633674 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.633748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.633821 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.633893 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.633991 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.634079 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.634171 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.634257 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.634348 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.634486 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.634595 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.634683 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.634769 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.634867 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.634957 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.635043 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.635204 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.635294 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.635378 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.635470 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.635556 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.635651 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.635738 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.635830 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.635917 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.636002 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.636087 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.636181 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.636282 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.636424 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.636566 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.636662 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.636756 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.636852 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.636947 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.637034 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.637126 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.637212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.637297 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.637391 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.637478 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.637571 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.637664 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.637751 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.637751 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.637928 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.638022 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.638109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.638200 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.638287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.638381 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.638468 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.638553 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.638645 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.638866 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.639672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.639821 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.639998 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.640174 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.640318 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.640535 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.640684 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.640871 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.640967 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.641193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.641296 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.641528 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.641637 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.641861 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.641957 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.642184 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.642286 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.642504 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.642635 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.642832 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.642937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.643146 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.643263 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.643470 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.643575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.644416 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.644559 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.644650 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.644735 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.644831 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.644918 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.645001 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.645093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.645186 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.645271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.645364 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.645451 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.645665 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.645779 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.645967 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.646079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.646282 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.646387 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.646590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.646720 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.646909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.647021 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.647223 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.647319 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.647527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.647628 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.647834 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.647944 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.648148 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.648245 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.648490 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.648588 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.648802 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.648916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.649115 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.649209 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.649421 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.649523 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.649732 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.649837 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.650042 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.650138 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.650353 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.650459 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.650667 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.650808 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.650974 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.651077 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.651287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.651382 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.651599 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.651705 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.651911 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.652008 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.652221 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.652347 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.652570 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.652675 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.652901 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.652998 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.653230 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.653339 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.653560 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.653656 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.653883 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.653990 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.654213 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.654320 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.654568 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.655171 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.655518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.655657 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.655839 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.656130 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.656227 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.656414 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 16:44:42.656551 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.656881 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.657228 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.657552 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.657878 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.658201 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.658521 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.658841 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.659160 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.659496 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.659832 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.660148 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.660510 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.660842 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.661172 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.661498 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.661820 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.662162 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.662486 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.662812 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.663140 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.663462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.663784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.664111 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.664481 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.664823 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.665160 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.665481 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.665837 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.666149 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.666513 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.666837 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.667193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.667532 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.667860 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.668182 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.668527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 16:44:42.668781 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 16:44:42.717823 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO dbcounter [None req-67700919-18c0-4f85-b6eb-645797678266 None None] Registered counter for database nova_api May 23 16:44:42.728930 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO dbcounter [None req-99aca666-7b54-4b4a-9300-890215098ced None None] Registered counter for database nova_api May 23 16:44:42.738529 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_db.sqlalchemy.engines [None req-67700919-18c0-4f85-b6eb-645797678266 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 16:44:42.746107 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writer thread running {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 16:44:42.748714 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_db.sqlalchemy.engines [None req-99aca666-7b54-4b4a-9300-890215098ced None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124714) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 16:44:42.755896 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writer thread running {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 16:44:42.806505 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.context [None req-67700919-18c0-4f85-b6eb-645797678266 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3da232e7-0be9-4eeb-8f07-26e17f9287c7(cell1) {{(pid=124715) load_cells /opt/stack/nova/nova/context.py:464}} May 23 16:44:42.811022 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-67700919-18c0-4f85-b6eb-645797678266 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:44:42.812933 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.context [None req-99aca666-7b54-4b4a-9300-890215098ced None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3da232e7-0be9-4eeb-8f07-26e17f9287c7(cell1) {{(pid=124714) load_cells /opt/stack/nova/nova/context.py:464}} May 23 16:44:42.813062 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-67700919-18c0-4f85-b6eb-645797678266 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:44:42.813855 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-67700919-18c0-4f85-b6eb-645797678266 None None] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:44:42.815867 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-67700919-18c0-4f85-b6eb-645797678266 None None] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:44:42.817068 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-99aca666-7b54-4b4a-9300-890215098ced None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:44:42.817893 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO dbcounter [None req-67700919-18c0-4f85-b6eb-645797678266 None None] Registered counter for database nova_cell0 May 23 16:44:42.818684 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-99aca666-7b54-4b4a-9300-890215098ced None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:44:42.819500 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-99aca666-7b54-4b4a-9300-890215098ced None None] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:44:42.821524 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-99aca666-7b54-4b4a-9300-890215098ced None None] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:44:42.822018 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO dbcounter [None req-67700919-18c0-4f85-b6eb-645797678266 None None] Registered counter for database nova_cell1 May 23 16:44:42.823503 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO dbcounter [None req-99aca666-7b54-4b4a-9300-890215098ced None None] Registered counter for database nova_cell0 May 23 16:44:42.828492 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO dbcounter [None req-99aca666-7b54-4b4a-9300-890215098ced None None] Registered counter for database nova_cell1 May 23 16:44:42.829963 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_db.sqlalchemy.engines [None req-67700919-18c0-4f85-b6eb-645797678266 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 16:44:42.832277 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_db.sqlalchemy.engines [None req-67700919-18c0-4f85-b6eb-645797678266 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 16:44:42.837232 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_db.sqlalchemy.engines [None req-99aca666-7b54-4b4a-9300-890215098ced None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124714) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 16:44:42.838016 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_db.sqlalchemy.engines [None req-99aca666-7b54-4b4a-9300-890215098ced None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124714) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 16:44:42.838134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writer thread running {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 16:44:42.840255 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writer thread running {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 16:44:42.846299 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writer thread running {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 16:44:42.846648 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writer thread running {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 16:44:42.991617 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO dbcounter [None req-67700919-18c0-4f85-b6eb-645797678266 None None] Registered counter for database nova_cell0 May 23 16:44:42.992439 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO dbcounter [None req-99aca666-7b54-4b4a-9300-890215098ced None None] Registered counter for database nova_cell0 May 23 16:44:42.999089 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_db.sqlalchemy.engines [None req-67700919-18c0-4f85-b6eb-645797678266 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 16:44:43.000520 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_db.sqlalchemy.engines [None req-99aca666-7b54-4b4a-9300-890215098ced None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124714) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 16:44:43.003883 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writer thread running {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 16:44:43.004867 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writer thread running {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 16:44:43.327705 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: WARNING keystonemiddleware.auth_token [None req-67700919-18c0-4f85-b6eb-645797678266 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 16:44:43.334784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: WARNING keystonemiddleware.auth_token [None req-99aca666-7b54-4b4a-9300-890215098ced None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 16:44:43.335262 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: WARNING keystonemiddleware.auth_token [None req-67700919-18c0-4f85-b6eb-645797678266 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 16:44:43.342432 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: WARNING keystonemiddleware.auth_token [None req-99aca666-7b54-4b4a-9300-890215098ced None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 16:44:43.684918 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: WARNING keystonemiddleware.auth_token [None req-67700919-18c0-4f85-b6eb-645797678266 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 16:44:43.690955 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: WARNING keystonemiddleware.auth_token [None req-67700919-18c0-4f85-b6eb-645797678266 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 16:44:43.695290 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: WARNING keystonemiddleware.auth_token [None req-99aca666-7b54-4b4a-9300-890215098ced None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 16:44:43.696286 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559e876fc9c0 pid: 124715 (default app) May 23 16:44:43.703062 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: WARNING keystonemiddleware.auth_token [None req-99aca666-7b54-4b4a-9300-890215098ced None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 16:44:43.707098 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559e876fc9c0 pid: 124714 (default app) May 23 16:45:26.728933 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=3 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:26.730666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=3 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:26.731783 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=3 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:26.732589 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=3 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:27.903882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-88454748-98e0-4e0a-9bcf-4d314c193d5b tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] Action: 'create', calling method: .version_select at 0x7f224e524c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-540555152", "metadata": {"Type": "work"}}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:45:27.919947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-88454748-98e0-4e0a-9bcf-4d314c193d5b tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] Request method failure captured: May 23 16:45:27.919947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 16:45:27.919947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:45:27.919947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:45:27.919947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:45:27.919947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 121 May 23 16:45:27.919947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:45:27.919947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:45:27.919947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:45:27.919947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:45:27.919947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7omYPFnprPr1Gc20zaYAS44T5w0ry_f6mObyUf4U-whohHQuHTpKbuOiZl7l6iPhN7DWBHwvlgl-5SRf2Ervsc7WowPgSycveKaghYN1lYc5z9XGtHlzZGBsI-ighB0GE6mpuFy7hhm-hTWNJt-YY8ycA9hGqnd6ut2JajFq2PDf-0 May 23 16:45:27.919947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:45:27.919947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:45:27.919947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:45:27.919947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:45:27.919947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:45:27.919947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:45:27.919947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: 74e33cc37cea457aa637d73dbc4e141d May 23 16:45:27.919947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-VolumesNegativeTest-393170966 May 23 16:45:27.919947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:45:27.919947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:45:27.921520 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:45:27.921520 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-VolumesNegativeTest-393170966 May 23 16:45:27.921520 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: 74e33cc37cea457aa637d73dbc4e141d May 23 16:45:27.921520 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-VolumesNegativeTest-393170966 May 23 16:45:27.921520 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-VolumesNegativeTest-393170966-project May 23 16:45:27.921520 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:45:27.921520 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:45:27.921520 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: 0f018c1bdf2c43d59ae6f73b145665cc May 23 16:45:27.921520 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-VolumesNegativeTest-393170966-project May 23 16:45:27.921520 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: May 23 16:45:27.921520 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-540555152", "metadata": {"Type": "work"}}} May 23 16:45:27.921520 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: May 23 16:45:27.921520 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 16:45:27.922437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-540555152', 'metadata': {'Type': 'work'}}}} May 23 16:45:27.922437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:45:27.922437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:45:27.922437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 16:45:27.922437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 16:45:27.922437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 16:45:27.922437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise error May 23 16:45:27.922437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 23 16:45:27.922437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:45:27.922437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 23 16:45:27.922437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 16:45:27.922437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:45:27.922437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 16:45:27.922437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi '#$%' May 23 16:45:27.922437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:45:27.922437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:45:27.922437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:45:27.922437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:45:27.922437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:45:27.922437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:45:27.922437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:45:27.922437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:45:27.923805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 16:45:27.923805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 16:45:27.923805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:45:27.923805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:45:27.923805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 16:45:27.923805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 16:45:27.923805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 16:45:27.923805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 16:45:27.923805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 16:45:27.923805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 16:45:27.923805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 16:45:27.923805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:45:27.923805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:45:27.923805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:45:27.923805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:45:27.923805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:45:27.923805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:45:27.923805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 16:45:27.923805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 16:45:27.925330 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 16:45:27.925330 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:45:27.925330 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-88454748-98e0-4e0a-9bcf-4d314c193d5b tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:45:27.925330 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-88454748-98e0-4e0a-9bcf-4d314c193d5b tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.199271 May 23 16:45:27.925330 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 1/1] 10.222.0.74 () {60 vars in 1155 bytes} [Mon May 23 16:45:26 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1202 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 16:45:28.289980 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-3c9a694f-cdda-463d-be2f-10a3026166cd tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] Action: 'create', calling method: .version_select at 0x7f224eeac280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-776533804", "metadata": {"Type": "work"}}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:45:28.301941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-3c9a694f-cdda-463d-be2f-10a3026166cd tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] Request method failure captured: May 23 16:45:28.301941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 16:45:28.301941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:45:28.301941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:45:28.301941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:45:28.301941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 119 May 23 16:45:28.301941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:45:28.301941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:45:28.301941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:45:28.301941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:45:28.301941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7omYPFnprPr1Gc20zaYAS44T5w0ry_f6mObyUf4U-whohHQuHTpKbuOiZl7l6iPhN7DWBHwvlgl-5SRf2Ervsc7WowPgSycveKaghYN1lYc5z9XGtHlzZGBsI-ighB0GE6mpuFy7hhm-hTWNJt-YY8ycA9hGqnd6ut2JajFq2PDf-0 May 23 16:45:28.301941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:45:28.301941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:45:28.301941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:45:28.301941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:45:28.301941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:45:28.301941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:45:28.301941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: 74e33cc37cea457aa637d73dbc4e141d May 23 16:45:28.301941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-VolumesNegativeTest-393170966 May 23 16:45:28.301941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:45:28.301941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:45:28.303191 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:45:28.303191 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-VolumesNegativeTest-393170966 May 23 16:45:28.303191 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: 74e33cc37cea457aa637d73dbc4e141d May 23 16:45:28.303191 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-VolumesNegativeTest-393170966 May 23 16:45:28.303191 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-VolumesNegativeTest-393170966-project May 23 16:45:28.303191 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:45:28.303191 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:45:28.303191 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 0f018c1bdf2c43d59ae6f73b145665cc May 23 16:45:28.303191 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-VolumesNegativeTest-393170966-project May 23 16:45:28.303191 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: May 23 16:45:28.303191 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-776533804", "metadata": {"Type": "work"}}} May 23 16:45:28.303191 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: May 23 16:45:28.303191 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 16:45:28.303972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-776533804', 'metadata': {'Type': 'work'}}}} May 23 16:45:28.303972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:45:28.303972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:45:28.303972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 16:45:28.303972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 16:45:28.303972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 16:45:28.303972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise error May 23 16:45:28.303972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 23 16:45:28.303972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:45:28.303972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 23 16:45:28.303972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 16:45:28.303972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:45:28.303972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 16:45:28.303972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi '0' May 23 16:45:28.303972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:45:28.303972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:45:28.303972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:45:28.303972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:45:28.303972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:45:28.303972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:45:28.303972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:45:28.303972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:45:28.312409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 16:45:28.312409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 16:45:28.312409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:45:28.312409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:45:28.312409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 16:45:28.312409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 16:45:28.312409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 16:45:28.312409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 16:45:28.312409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 16:45:28.312409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 16:45:28.312409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 16:45:28.312409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:45:28.312409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:45:28.312409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:45:28.312409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:45:28.312409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:45:28.312409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:45:28.312409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 16:45:28.312409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 16:45:28.313683 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 16:45:28.313683 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:45:28.313683 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-3c9a694f-cdda-463d-be2f-10a3026166cd tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:45:28.313683 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-3c9a694f-cdda-463d-be2f-10a3026166cd tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.372677 May 23 16:45:28.313683 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 1/2] 10.222.0.74 () {60 vars in 1155 bytes} [Mon May 23 16:45:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 378 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 16:45:28.316194 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-9c580eb7-992f-4726-b826-c8014e817eed tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] Action: 'create', calling method: .version_select at 0x7f224e3f5ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1590224860", "metadata": {"Type": "work"}}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:45:28.319389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-9c580eb7-992f-4726-b826-c8014e817eed tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] Request method failure captured: May 23 16:45:28.319389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 16:45:28.319389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:45:28.319389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:45:28.319389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:45:28.319389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 119 May 23 16:45:28.319389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:45:28.319389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:45:28.319389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:45:28.319389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:45:28.319389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7omYPFnprPr1Gc20zaYAS44T5w0ry_f6mObyUf4U-whohHQuHTpKbuOiZl7l6iPhN7DWBHwvlgl-5SRf2Ervsc7WowPgSycveKaghYN1lYc5z9XGtHlzZGBsI-ighB0GE6mpuFy7hhm-hTWNJt-YY8ycA9hGqnd6ut2JajFq2PDf-0 May 23 16:45:28.319389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:45:28.319389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:45:28.319389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:45:28.319389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:45:28.319389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:45:28.319389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:45:28.319389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: 74e33cc37cea457aa637d73dbc4e141d May 23 16:45:28.319389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-VolumesNegativeTest-393170966 May 23 16:45:28.319389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:45:28.319389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:45:28.328741 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:45:28.328741 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-VolumesNegativeTest-393170966 May 23 16:45:28.328741 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: 74e33cc37cea457aa637d73dbc4e141d May 23 16:45:28.328741 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-VolumesNegativeTest-393170966 May 23 16:45:28.328741 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-VolumesNegativeTest-393170966-project May 23 16:45:28.328741 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:45:28.328741 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:45:28.328741 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: 0f018c1bdf2c43d59ae6f73b145665cc May 23 16:45:28.328741 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-VolumesNegativeTest-393170966-project May 23 16:45:28.328741 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: May 23 16:45:28.328741 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1590224860", "metadata": {"Type": "work"}}} May 23 16:45:28.328741 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: May 23 16:45:28.328741 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 16:45:28.329666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1590224860', 'metadata': {'Type': 'work'}}}} May 23 16:45:28.329666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:45:28.329666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:45:28.329666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 16:45:28.329666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 16:45:28.329666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 16:45:28.329666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise error May 23 16:45:28.329666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 23 16:45:28.329666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:45:28.329666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 23 16:45:28.329666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 16:45:28.329666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:45:28.329666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 16:45:28.329666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi '' May 23 16:45:28.329666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:45:28.329666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:45:28.329666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:45:28.329666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:45:28.329666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:45:28.329666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:45:28.329666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:45:28.329666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:45:28.331211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 16:45:28.331211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 16:45:28.331211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:45:28.331211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:45:28.331211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 16:45:28.331211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 16:45:28.331211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 16:45:28.331211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 16:45:28.331211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 16:45:28.331211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 16:45:28.331211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 16:45:28.331211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:45:28.331211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:45:28.331211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:45:28.331211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:45:28.331211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:45:28.331211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:45:28.331211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 16:45:28.331211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 16:45:28.333212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 16:45:28.333212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:45:28.333212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-9c580eb7-992f-4726-b826-c8014e817eed tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:45:28.333212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-9c580eb7-992f-4726-b826-c8014e817eed tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008495 May 23 16:45:28.333212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 2/3] 10.222.0.74 () {60 vars in 1155 bytes} [Mon May 23 16:45:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 16:45:28.334053 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-1be7fb1e-3e96-4e9a-90a6-9a1b96fefc61 tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] Calling method '.version_select at 0x7f224e4f8a60>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:28.397937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=3 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:28.398819 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=3 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:28.399820 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=3 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:28.400896 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=3 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:28.774153 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-1be7fb1e-3e96-4e9a-90a6-9a1b96fefc61 tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] HTTP exception thrown: Volume tempest-invalid-1386064134 could not be found. May 23 16:45:28.779079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-1be7fb1e-3e96-4e9a-90a6-9a1b96fefc61 tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] Request method failure captured: May 23 16:45:28.779079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1386064134 HTTP/1.1 May 23 16:45:28.779079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:45:28.779079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:45:28.779079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:45:28.779079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 16:45:28.779079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:45:28.779079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:45:28.779079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:45:28.779079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:45:28.779079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7omYPFnprPr1Gc20zaYAS44T5w0ry_f6mObyUf4U-whohHQuHTpKbuOiZl7l6iPhN7DWBHwvlgl-5SRf2Ervsc7WowPgSycveKaghYN1lYc5z9XGtHlzZGBsI-ighB0GE6mpuFy7hhm-hTWNJt-YY8ycA9hGqnd6ut2JajFq2PDf-0 May 23 16:45:28.779079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:45:28.779079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:45:28.779079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:45:28.779079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:45:28.779079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:45:28.779079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:45:28.779079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: 74e33cc37cea457aa637d73dbc4e141d May 23 16:45:28.779079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-VolumesNegativeTest-393170966 May 23 16:45:28.779079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:45:28.779079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:45:28.780691 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:45:28.780691 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-VolumesNegativeTest-393170966 May 23 16:45:28.780691 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: 74e33cc37cea457aa637d73dbc4e141d May 23 16:45:28.780691 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-VolumesNegativeTest-393170966 May 23 16:45:28.780691 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-VolumesNegativeTest-393170966-project May 23 16:45:28.780691 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:45:28.780691 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:45:28.780691 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 0f018c1bdf2c43d59ae6f73b145665cc May 23 16:45:28.780691 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-VolumesNegativeTest-393170966-project May 23 16:45:28.780691 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: May 23 16:45:28.780691 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Volume tempest-invalid-1386064134 could not be found. May 23 16:45:28.780691 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': 'tempest-invalid-1386064134'} May 23 16:45:28.780691 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:45:28.781685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:45:28.781685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 16:45:28.781685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 16:45:28.781685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 16:45:28.781685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 16:45:28.781685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 16:45:28.781685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 16:45:28.781685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 16:45:28.781685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 16:45:28.781685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 16:45:28.781685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 16:45:28.781685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 16:45:28.781685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 16:45:28.781685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 16:45:28.781685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 16:45:28.781685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1386064134 could not be found. (HTTP 404) (Request-ID: req-c9fcecab-1883-4467-b722-755cbb0e2386) May 23 16:45:28.781685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:45:28.781685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:45:28.781685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:45:28.783057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:45:28.783057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 16:45:28.783057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 16:45:28.783057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 16:45:28.783057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 16:45:28.783057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 16:45:28.783057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 16:45:28.783057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 16:45:28.783057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 16:45:28.783057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 16:45:28.783057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 16:45:28.783057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 16:45:28.783057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 16:45:28.783057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 16:45:28.783057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 16:45:28.783057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 16:45:28.783057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 16:45:28.783057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 16:45:28.783057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 16:45:28.785030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 16:45:28.785030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 16:45:28.785030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 16:45:28.785030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 16:45:28.785030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1386064134 could not be found. May 23 16:45:28.785030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:45:28.785030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:45:28.785030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:45:28.785030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:45:28.785030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:45:28.785030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:45:28.785030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:45:28.785030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:45:28.785030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 16:45:28.785030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 16:45:28.785030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:45:28.785030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:45:28.785030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 16:45:28.785030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:45:28.785030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1386064134 could not be found. May 23 16:45:28.787376 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:45:28.787376 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:45:28.787376 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:45:28.787376 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:45:28.787376 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:45:28.787376 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:45:28.787376 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:45:28.787376 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:45:28.787376 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1386064134 could not be found. May 23 16:45:28.787376 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:45:28.789897 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-1be7fb1e-3e96-4e9a-90a6-9a1b96fefc61 tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] Returning 404 to user: Volume tempest-invalid-1386064134 could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:45:28.793696 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-1be7fb1e-3e96-4e9a-90a6-9a1b96fefc61 tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1386064134" status: 404 len: 99 microversion: 2.1 time: 0.461442 May 23 16:45:28.794509 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 2/4] 10.222.0.74 () {58 vars in 1217 bytes} [Mon May 23 16:45:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1386064134 => generated 99 bytes in 465 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 23 16:45:28.816490 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-f9b55160-05d4-4bdc-8bc5-35b475145f4c tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004442 May 23 16:45:28.817301 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 3/5] 10.222.0.74 () {58 vars in 1139 bytes} [Mon May 23 16:45:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 23 16:45:28.828969 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-082e2d12-da9f-44dd-a0f5-4cc805fc2718 tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005416 May 23 16:45:28.829607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 3/6] 10.222.0.74 () {58 vars in 1136 bytes} [Mon May 23 16:45:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 23 16:45:28.839366 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-38bb5a50-dd84-4879-965f-8dcbddfce729 tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] Calling method '.version_select at 0x7f224e524d30>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:29.003853 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-38bb5a50-dd84-4879-965f-8dcbddfce729 tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] HTTP exception thrown: Volume 3c209fec-a110-46cf-8300-9e8bd76d5a6e could not be found. May 23 16:45:29.009600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-38bb5a50-dd84-4879-965f-8dcbddfce729 tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] Request method failure captured: May 23 16:45:29.009600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: DELETE /compute/v2.1/os-volumes/3c209fec-a110-46cf-8300-9e8bd76d5a6e HTTP/1.1 May 23 16:45:29.009600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:45:29.009600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:45:29.009600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:45:29.009600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:45:29.009600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:45:29.009600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:45:29.009600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:45:29.009600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:45:29.009600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7omYPFnprPr1Gc20zaYAS44T5w0ry_f6mObyUf4U-whohHQuHTpKbuOiZl7l6iPhN7DWBHwvlgl-5SRf2Ervsc7WowPgSycveKaghYN1lYc5z9XGtHlzZGBsI-ighB0GE6mpuFy7hhm-hTWNJt-YY8ycA9hGqnd6ut2JajFq2PDf-0 May 23 16:45:29.009600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:45:29.009600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:45:29.009600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:45:29.009600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:45:29.009600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:45:29.009600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:45:29.009600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: 74e33cc37cea457aa637d73dbc4e141d May 23 16:45:29.009600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-VolumesNegativeTest-393170966 May 23 16:45:29.009600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:45:29.009600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:45:29.011476 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:45:29.011476 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-VolumesNegativeTest-393170966 May 23 16:45:29.011476 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: 74e33cc37cea457aa637d73dbc4e141d May 23 16:45:29.011476 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-VolumesNegativeTest-393170966 May 23 16:45:29.011476 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-VolumesNegativeTest-393170966-project May 23 16:45:29.011476 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:45:29.011476 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:45:29.011476 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: 0f018c1bdf2c43d59ae6f73b145665cc May 23 16:45:29.011476 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-VolumesNegativeTest-393170966-project May 23 16:45:29.011476 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: May 23 16:45:29.011476 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Volume 3c209fec-a110-46cf-8300-9e8bd76d5a6e could not be found. May 23 16:45:29.011476 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': '3c209fec-a110-46cf-8300-9e8bd76d5a6e'} May 23 16:45:29.011476 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:45:29.012284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:45:29.012284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 16:45:29.012284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 16:45:29.012284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 16:45:29.012284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 16:45:29.012284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 16:45:29.012284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 16:45:29.012284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 16:45:29.012284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 16:45:29.012284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 16:45:29.012284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 16:45:29.012284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 16:45:29.012284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 16:45:29.012284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 16:45:29.012284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 16:45:29.012284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c209fec-a110-46cf-8300-9e8bd76d5a6e could not be found. (HTTP 404) (Request-ID: req-b3e834ee-b0be-4c09-a0fa-7489a54ee719) May 23 16:45:29.012284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:45:29.012284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:45:29.012284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:45:29.013429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:45:29.013429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 16:45:29.013429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 16:45:29.013429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 16:45:29.013429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 16:45:29.013429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 16:45:29.013429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 16:45:29.013429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 16:45:29.013429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 16:45:29.013429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 16:45:29.013429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 16:45:29.013429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 16:45:29.013429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 16:45:29.013429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 16:45:29.013429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 16:45:29.013429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 16:45:29.013429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 16:45:29.013429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 16:45:29.013429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 16:45:29.014559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 16:45:29.014559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 16:45:29.014559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 16:45:29.014559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 16:45:29.014559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c209fec-a110-46cf-8300-9e8bd76d5a6e could not be found. May 23 16:45:29.014559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:45:29.014559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:45:29.014559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:45:29.014559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:45:29.014559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:45:29.014559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:45:29.014559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:45:29.014559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:45:29.014559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 16:45:29.014559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 16:45:29.014559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:45:29.014559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:45:29.014559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 16:45:29.014559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:45:29.016203 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c209fec-a110-46cf-8300-9e8bd76d5a6e could not be found. May 23 16:45:29.016203 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:45:29.016203 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:45:29.016203 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:45:29.016203 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:45:29.016203 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:45:29.016203 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:45:29.016203 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:45:29.016203 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:45:29.016203 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c209fec-a110-46cf-8300-9e8bd76d5a6e could not be found. May 23 16:45:29.016203 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:45:29.016203 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-38bb5a50-dd84-4879-965f-8dcbddfce729 tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] Returning 404 to user: Volume 3c209fec-a110-46cf-8300-9e8bd76d5a6e could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:45:29.016203 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-38bb5a50-dd84-4879-965f-8dcbddfce729 tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/3c209fec-a110-46cf-8300-9e8bd76d5a6e" status: 404 len: 109 microversion: 2.1 time: 0.177638 May 23 16:45:29.016203 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 4/7] 10.222.0.74 () {58 vars in 1247 bytes} [Mon May 23 16:45:28 2022] DELETE /compute/v2.1/os-volumes/3c209fec-a110-46cf-8300-9e8bd76d5a6e => generated 109 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 16:45:29.025145 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-bcd27dbf-4814-4f90-9dd4-bcc11b2869ef tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] Calling method '.version_select at 0x7f224e2eeb80>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:29.071834 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-bcd27dbf-4814-4f90-9dd4-bcc11b2869ef tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] HTTP exception thrown: Volume 8d880d1d-8a3f-49ae-ab09-ff67eee2d97f could not be found. May 23 16:45:29.074089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-bcd27dbf-4814-4f90-9dd4-bcc11b2869ef tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] Request method failure captured: May 23 16:45:29.074089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: GET /compute/v2.1/os-volumes/8d880d1d-8a3f-49ae-ab09-ff67eee2d97f HTTP/1.1 May 23 16:45:29.074089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:45:29.074089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:45:29.074089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:45:29.074089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 16:45:29.074089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:45:29.074089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:45:29.074089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:45:29.074089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:45:29.074089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7omYPFnprPr1Gc20zaYAS44T5w0ry_f6mObyUf4U-whohHQuHTpKbuOiZl7l6iPhN7DWBHwvlgl-5SRf2Ervsc7WowPgSycveKaghYN1lYc5z9XGtHlzZGBsI-ighB0GE6mpuFy7hhm-hTWNJt-YY8ycA9hGqnd6ut2JajFq2PDf-0 May 23 16:45:29.074089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:45:29.074089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:45:29.074089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:45:29.074089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:45:29.074089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:45:29.074089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:45:29.074089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: 74e33cc37cea457aa637d73dbc4e141d May 23 16:45:29.074089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-VolumesNegativeTest-393170966 May 23 16:45:29.074089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:45:29.074089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:45:29.075858 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_74e33cc37cea457aa637d73dbc4e141d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:45:29.075858 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-VolumesNegativeTest-393170966 May 23 16:45:29.075858 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: 74e33cc37cea457aa637d73dbc4e141d May 23 16:45:29.075858 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-VolumesNegativeTest-393170966 May 23 16:45:29.075858 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-VolumesNegativeTest-393170966-project May 23 16:45:29.075858 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:45:29.075858 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:45:29.075858 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 0f018c1bdf2c43d59ae6f73b145665cc May 23 16:45:29.075858 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-VolumesNegativeTest-393170966-project May 23 16:45:29.075858 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: May 23 16:45:29.075858 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Volume 8d880d1d-8a3f-49ae-ab09-ff67eee2d97f could not be found. May 23 16:45:29.075858 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': '8d880d1d-8a3f-49ae-ab09-ff67eee2d97f'} May 23 16:45:29.075858 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:45:29.076839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:45:29.076839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 16:45:29.076839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 16:45:29.076839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 16:45:29.076839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 16:45:29.076839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 16:45:29.076839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 16:45:29.076839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 16:45:29.076839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 16:45:29.076839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 16:45:29.076839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 16:45:29.076839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 16:45:29.076839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 16:45:29.076839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 16:45:29.076839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 16:45:29.076839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8d880d1d-8a3f-49ae-ab09-ff67eee2d97f could not be found. (HTTP 404) (Request-ID: req-a4d084c6-6e47-4413-a843-67961670efc8) May 23 16:45:29.076839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:45:29.076839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:45:29.076839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:45:29.077960 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:45:29.077960 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 16:45:29.077960 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 16:45:29.077960 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 16:45:29.077960 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 16:45:29.077960 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 16:45:29.077960 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 16:45:29.077960 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 16:45:29.077960 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 16:45:29.077960 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 16:45:29.077960 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 16:45:29.077960 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 16:45:29.077960 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 16:45:29.077960 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 16:45:29.077960 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 16:45:29.077960 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 16:45:29.077960 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 16:45:29.077960 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 16:45:29.077960 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 16:45:29.079082 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 16:45:29.079082 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 16:45:29.079082 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 16:45:29.079082 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 16:45:29.079082 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8d880d1d-8a3f-49ae-ab09-ff67eee2d97f could not be found. May 23 16:45:29.079082 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:45:29.079082 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:45:29.079082 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:45:29.079082 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:45:29.079082 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:45:29.079082 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:45:29.079082 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:45:29.079082 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:45:29.079082 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 16:45:29.079082 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 16:45:29.079082 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:45:29.079082 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:45:29.079082 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 16:45:29.079082 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:45:29.080472 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8d880d1d-8a3f-49ae-ab09-ff67eee2d97f could not be found. May 23 16:45:29.080472 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:45:29.080472 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:45:29.080472 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:45:29.080472 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:45:29.080472 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:45:29.080472 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:45:29.080472 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:45:29.080472 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:45:29.080472 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8d880d1d-8a3f-49ae-ab09-ff67eee2d97f could not be found. May 23 16:45:29.080472 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:45:29.080472 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-bcd27dbf-4814-4f90-9dd4-bcc11b2869ef tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] Returning 404 to user: Volume 8d880d1d-8a3f-49ae-ab09-ff67eee2d97f could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:45:29.080472 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-bcd27dbf-4814-4f90-9dd4-bcc11b2869ef tempest-VolumesNegativeTest-393170966 tempest-VolumesNegativeTest-393170966-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/8d880d1d-8a3f-49ae-ab09-ff67eee2d97f" status: 404 len: 109 microversion: 2.1 time: 0.060535 May 23 16:45:29.081537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 4/8] 10.222.0.74 () {58 vars in 1244 bytes} [Mon May 23 16:45:29 2022] GET /compute/v2.1/os-volumes/8d880d1d-8a3f-49ae-ab09-ff67eee2d97f => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:45:30.013333 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-1846a483-947c-4ae1-90c6-819b479df3ee tempest-VolumesTestJSON-410592203 tempest-VolumesTestJSON-410592203-project] Calling method '.version_select at 0x7f224e2ee4c0>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:30.104692 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-1846a483-947c-4ae1-90c6-819b479df3ee tempest-VolumesTestJSON-410592203 tempest-VolumesTestJSON-410592203-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/e4a4d03e-3868-443a-91d4-802633eeca39" status: 200 len: 350 microversion: 2.1 time: 0.096517 May 23 16:45:30.105576 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 5/9] 10.222.0.74 () {58 vars in 1244 bytes} [Mon May 23 16:45:30 2022] GET /compute/v2.1/os-volumes/e4a4d03e-3868-443a-91d4-802633eeca39 => generated 350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:45:30.267783 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-83d61c36-1ac7-4528-88a7-88c8bc672d81 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-676227729", "imageRef": "96972e76-879d-4149-a713-a94529892aad", "flavorRef": "452", "networks": [{"uuid": "fbd1e766-f5b7-46cf-9848-ac7342f3664d"}]}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:45:30.481923 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.network.neutron [None req-83d61c36-1ac7-4528-88a7-88c8bc672d81 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] validate_networks() for [('fbd1e766-f5b7-46cf-9848-ac7342f3664d', None, None, None, None, None)] {{(pid=124715) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 16:45:31.558723 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-83d61c36-1ac7-4528-88a7-88c8bc672d81 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Flavor limits 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 16:45:31.560878 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-83d61c36-1ac7-4528-88a7-88c8bc672d81 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Image limits 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 16:45:31.561961 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-83d61c36-1ac7-4528-88a7-88c8bc672d81 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Flavor pref 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 16:45:31.562376 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-83d61c36-1ac7-4528-88a7-88c8bc672d81 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Image pref 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 16:45:31.562790 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-83d61c36-1ac7-4528-88a7-88c8bc672d81 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 16:45:31.589075 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-83d61c36-1ac7-4528-88a7-88c8bc672d81 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:31.599234 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-83d61c36-1ac7-4528-88a7-88c8bc672d81 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:31.599234 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-83d61c36-1ac7-4528-88a7-88c8bc672d81 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:31.599234 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-83d61c36-1ac7-4528-88a7-88c8bc672d81 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:31.641987 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-83d61c36-1ac7-4528-88a7-88c8bc672d81 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Getting quotas for project fc5c77313d114be8a334b6009147d627. Resources: {'cores', 'instances', 'ram'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:45:31.650493 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-83d61c36-1ac7-4528-88a7-88c8bc672d81 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Getting quotas for user 8d7100e6b15442e895c72cb41116e76b and project fc5c77313d114be8a334b6009147d627. Resources: {'cores', 'instances', 'ram'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:45:31.663539 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-83d61c36-1ac7-4528-88a7-88c8bc672d81 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Going to run 1 instances... {{(pid=124715) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 16:45:31.666381 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-83d61c36-1ac7-4528-88a7-88c8bc672d81 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96972e76-879d-4149-a713-a94529892aad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 16:45:31.957633 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-83d61c36-1ac7-4528-88a7-88c8bc672d81 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.171883 May 23 16:45:31.963023 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 5/10] 10.222.0.74 () {60 vars in 1146 bytes} [Mon May 23 16:45:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 16:45:31.970473 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-1cf3d006-f14f-4d6d-8c91-ec0d8b27523f tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:31.971327 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-1cf3d006-f14f-4d6d-8c91-ec0d8b27523f tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:32.132349 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-1cf3d006-f14f-4d6d-8c91-ec0d8b27523f tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:32.157256 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-1cf3d006-f14f-4d6d-8c91-ec0d8b27523f tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1214 microversion: 2.1 time: 0.191511 May 23 16:45:32.157839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 6/11] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:45:31 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1214 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:45:33.190664 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-5a1b391e-f831-45ff-b198-ea189b54246a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:33.202354 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-5a1b391e-f831-45ff-b198-ea189b54246a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:33.203208 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-b32cddba-88d3-43fd-849a-aeedd5942ec6 tempest-VolumesTestJSON-410592203 tempest-VolumesTestJSON-410592203-project] Calling method '.version_select at 0x7f224da06c10>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:33.277132 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-b32cddba-88d3-43fd-849a-aeedd5942ec6 tempest-VolumesTestJSON-410592203 tempest-VolumesTestJSON-410592203-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/0b59f316-3f44-4c71-aa89-3e9a39f0e485" status: 200 len: 350 microversion: 2.1 time: 0.101121 May 23 16:45:33.286774 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 6/12] 10.222.0.74 () {58 vars in 1244 bytes} [Mon May 23 16:45:33 2022] GET /compute/v2.1/os-volumes/0b59f316-3f44-4c71-aa89-3e9a39f0e485 => generated 350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:45:33.315995 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-5a1b391e-f831-45ff-b198-ea189b54246a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:33.327997 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-5a1b391e-f831-45ff-b198-ea189b54246a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1214 microversion: 2.1 time: 0.153902 May 23 16:45:33.334617 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 7/13] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:45:33 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1214 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:45:34.351059 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e917a037-095f-42ee-8914-d68a0f6a3c6a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:34.352048 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e917a037-095f-42ee-8914-d68a0f6a3c6a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:34.535969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e917a037-095f-42ee-8914-d68a0f6a3c6a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:34.567486 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e917a037-095f-42ee-8914-d68a0f6a3c6a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1214 microversion: 2.1 time: 0.216444 May 23 16:45:34.579633 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 7/14] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:45:34 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1214 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:45:35.352425 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-7c36bed8-fe88-464e-8759-6db955941acd tempest-VolumesTestJSON-410592203 tempest-VolumesTestJSON-410592203-project] Calling method '.version_select at 0x7f224e2eec10>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:35.513151 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-7c36bed8-fe88-464e-8759-6db955941acd tempest-VolumesTestJSON-410592203 tempest-VolumesTestJSON-410592203-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/cc3c32e3-432f-42e8-8629-974dcdc9072d" status: 200 len: 351 microversion: 2.1 time: 0.164844 May 23 16:45:35.514442 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 8/15] 10.222.0.74 () {58 vars in 1244 bytes} [Mon May 23 16:45:35 2022] GET /compute/v2.1/os-volumes/cc3c32e3-432f-42e8-8629-974dcdc9072d => generated 351 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:45:35.525412 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-ed9ffe52-e757-43a9-901c-322900a9e4ed tempest-VolumesTestJSON-410592203 tempest-VolumesTestJSON-410592203-project] Calling method '.version_select at 0x7f224da1edc0>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:35.595212 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-2583fc95-24e5-48e4-87de-892300c46251 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:35.595837 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-2583fc95-24e5-48e4-87de-892300c46251 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:35.626615 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2583fc95-24e5-48e4-87de-892300c46251 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:35.627085 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2583fc95-24e5-48e4-87de-892300c46251 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:35.627880 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2583fc95-24e5-48e4-87de-892300c46251 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:35.631767 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2583fc95-24e5-48e4-87de-892300c46251 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:35.747447 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-ed9ffe52-e757-43a9-901c-322900a9e4ed tempest-VolumesTestJSON-410592203 tempest-VolumesTestJSON-410592203-project] 10.222.0.74 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.225836 May 23 16:45:35.748032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 8/16] 10.222.0.74 () {58 vars in 1133 bytes} [Mon May 23 16:45:35 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:45:35.762526 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-2e9a1aa8-bb47-4f0c-acb9-336c9ca18b3c tempest-VolumesTestJSON-410592203 tempest-VolumesTestJSON-410592203-project] Calling method '.version_select at 0x7f224e2f0700>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:35.901726 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-2e9a1aa8-bb47-4f0c-acb9-336c9ca18b3c tempest-VolumesTestJSON-410592203 tempest-VolumesTestJSON-410592203-project] 10.222.0.74 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.145170 May 23 16:45:35.902301 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 9/17] 10.222.0.74 () {58 vars in 1148 bytes} [Mon May 23 16:45:35 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:45:35.915534 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-3d9cfa30-35fd-439e-92b8-8fd4dd7cd403 tempest-VolumesTestJSON-410592203 tempest-VolumesTestJSON-410592203-project] Calling method '.version_select at 0x7f224d1bf8b0>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:35.978716 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-2583fc95-24e5-48e4-87de-892300c46251 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:36.005824 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-2583fc95-24e5-48e4-87de-892300c46251 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1218 microversion: 2.1 time: 0.414414 May 23 16:45:36.006940 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 9/18] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:45:35 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1218 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:45:36.028858 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-3d9cfa30-35fd-439e-92b8-8fd4dd7cd403 tempest-VolumesTestJSON-410592203 tempest-VolumesTestJSON-410592203-project] 10.222.0.74 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.117791 May 23 16:45:36.029431 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 10/19] 10.222.0.74 () {58 vars in 1133 bytes} [Mon May 23 16:45:35 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:45:36.043140 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-9d12fc01-4586-41d4-8b4a-875c18034d15 tempest-VolumesTestJSON-410592203 tempest-VolumesTestJSON-410592203-project] Calling method '.version_select at 0x7f224e239700>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:36.181425 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-9d12fc01-4586-41d4-8b4a-875c18034d15 tempest-VolumesTestJSON-410592203 tempest-VolumesTestJSON-410592203-project] 10.222.0.74 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.133797 May 23 16:45:36.181425 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 10/20] 10.222.0.74 () {58 vars in 1166 bytes} [Mon May 23 16:45:36 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:45:36.186189 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-796f08a9-fac9-4089-82ac-245e245197ce tempest-VolumesTestJSON-410592203 tempest-VolumesTestJSON-410592203-project] Calling method '.version_select at 0x7f224d1cf550>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:36.329554 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-796f08a9-fac9-4089-82ac-245e245197ce tempest-VolumesTestJSON-410592203 tempest-VolumesTestJSON-410592203-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.148422 May 23 16:45:36.330711 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 11/21] 10.222.0.74 () {58 vars in 1169 bytes} [Mon May 23 16:45:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:45:36.345463 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-f86b30d5-43ab-48a8-b150-11775986095a tempest-VolumesTestJSON-410592203 tempest-VolumesTestJSON-410592203-project] Calling method '.version_select at 0x7f224e242310>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:36.484188 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-f86b30d5-43ab-48a8-b150-11775986095a tempest-VolumesTestJSON-410592203 tempest-VolumesTestJSON-410592203-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.144916 May 23 16:45:36.484815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 11/22] 10.222.0.74 () {58 vars in 1154 bytes} [Mon May 23 16:45:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:45:36.501016 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-bb5b0847-440a-4772-838f-1e877b007a51 tempest-VolumesTestJSON-410592203 tempest-VolumesTestJSON-410592203-project] Calling method '.version_select at 0x7f224d1bfdc0>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:36.652908 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-bb5b0847-440a-4772-838f-1e877b007a51 tempest-VolumesTestJSON-410592203 tempest-VolumesTestJSON-410592203-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.154975 May 23 16:45:36.661747 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 12/23] 10.222.0.74 () {58 vars in 1187 bytes} [Mon May 23 16:45:36 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:45:36.666833 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-42dd20a1-872a-4e79-8468-bb5e9d89b079 tempest-VolumesTestJSON-410592203 tempest-VolumesTestJSON-410592203-project] Calling method '.version_select at 0x7f224e239dc0>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:36.838177 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-42dd20a1-872a-4e79-8468-bb5e9d89b079 tempest-VolumesTestJSON-410592203 tempest-VolumesTestJSON-410592203-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.176297 May 23 16:45:36.839897 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 12/24] 10.222.0.74 () {58 vars in 1154 bytes} [Mon May 23 16:45:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:45:37.023657 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-907b39a6-3f92-481e-8448-234fd5abffaa tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:37.024468 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-907b39a6-3f92-481e-8448-234fd5abffaa tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:37.034251 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-907b39a6-3f92-481e-8448-234fd5abffaa tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:37.035009 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-907b39a6-3f92-481e-8448-234fd5abffaa tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:37.037221 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-907b39a6-3f92-481e-8448-234fd5abffaa tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:37.037800 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-907b39a6-3f92-481e-8448-234fd5abffaa tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:37.626244 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-907b39a6-3f92-481e-8448-234fd5abffaa tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:37.648961 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-907b39a6-3f92-481e-8448-234fd5abffaa tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1218 microversion: 2.1 time: 0.619485 May 23 16:45:37.650166 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 13/25] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:45:37 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1218 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:45:38.659439 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-ebad36b3-cd17-4a9d-be1d-66a87c86c0bc tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:38.661664 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-ebad36b3-cd17-4a9d-be1d-66a87c86c0bc tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:38.674994 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ebad36b3-cd17-4a9d-be1d-66a87c86c0bc tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:38.675665 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ebad36b3-cd17-4a9d-be1d-66a87c86c0bc tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:38.677082 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ebad36b3-cd17-4a9d-be1d-66a87c86c0bc tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:38.677705 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ebad36b3-cd17-4a9d-be1d-66a87c86c0bc tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:38.748404 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-fd6c105a-b4b8-4281-956e-64b85345440e tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Action: 'create', calling method: .version_select at 0x7f224e2b7700>, body: {"keypair": {"name": "tempest-keypair-1659597792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEr188fIa4ZtVsVazaK0BUqqLtGdcFyxgZzwBEF5E7jC/mIZ5o2K0ElluxOcJ9fkILXziMBGV0D3Zk+gzaYonS+dYHOTr7p4TAjqTukIJXtBp5Mxi96v5XUAahcnK+vOUw=="}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:45:38.840014 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-ebad36b3-cd17-4a9d-be1d-66a87c86c0bc tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:38.855632 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-ebad36b3-cd17-4a9d-be1d-66a87c86c0bc tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1210 microversion: 2.1 time: 0.200333 May 23 16:45:38.857435 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-fd6c105a-b4b8-4281-956e-64b85345440e tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Getting quotas for project e293f2b3de9143ad9e8a1fe8b67d6641. Resources: {'key_pairs'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:45:38.872402 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 14/26] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:45:38 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1210 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:45:38.872571 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-fd6c105a-b4b8-4281-956e-64b85345440e tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Getting quotas for user 718a82d2f4294f68965ce01aac0fc166 and project e293f2b3de9143ad9e8a1fe8b67d6641. Resources: {'key_pairs'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:45:39.074997 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-fd6c105a-b4b8-4281-956e-64b85345440e tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.559423 May 23 16:45:39.076569 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 13/27] 10.222.0.74 () {60 vars in 1158 bytes} [Mon May 23 16:45:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:45:39.880103 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-4703dcba-cf1f-4110-bcd0-c817d2408306 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:39.881081 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-4703dcba-cf1f-4110-bcd0-c817d2408306 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:39.894966 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4703dcba-cf1f-4110-bcd0-c817d2408306 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:39.895425 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4703dcba-cf1f-4110-bcd0-c817d2408306 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:39.896217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4703dcba-cf1f-4110-bcd0-c817d2408306 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:39.896694 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4703dcba-cf1f-4110-bcd0-c817d2408306 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:40.072697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-4703dcba-cf1f-4110-bcd0-c817d2408306 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:40.083031 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-4703dcba-cf1f-4110-bcd0-c817d2408306 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1210 microversion: 2.1 time: 0.206644 May 23 16:45:40.086093 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 15/28] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:45:39 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1210 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:45:41.105916 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-c595c686-0922-48b6-b95e-dff16442971a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:41.106357 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-c595c686-0922-48b6-b95e-dff16442971a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:41.117636 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c595c686-0922-48b6-b95e-dff16442971a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:41.122527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c595c686-0922-48b6-b95e-dff16442971a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:41.123590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c595c686-0922-48b6-b95e-dff16442971a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:41.124393 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c595c686-0922-48b6-b95e-dff16442971a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:41.375753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-c595c686-0922-48b6-b95e-dff16442971a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:41.397482 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-c595c686-0922-48b6-b95e-dff16442971a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1274 microversion: 2.1 time: 0.295787 May 23 16:45:41.398129 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 14/29] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:45:41 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1274 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:45:42.416935 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a3a99bf0-ae7b-4958-ae0c-8cdc8ca865e3 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:42.418473 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a3a99bf0-ae7b-4958-ae0c-8cdc8ca865e3 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:42.420911 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=2 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:42.442049 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a3a99bf0-ae7b-4958-ae0c-8cdc8ca865e3 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:42.445957 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a3a99bf0-ae7b-4958-ae0c-8cdc8ca865e3 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:42.450646 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a3a99bf0-ae7b-4958-ae0c-8cdc8ca865e3 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:42.451254 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a3a99bf0-ae7b-4958-ae0c-8cdc8ca865e3 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:42.902309 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a3a99bf0-ae7b-4958-ae0c-8cdc8ca865e3 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:42.918096 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a3a99bf0-ae7b-4958-ae0c-8cdc8ca865e3 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1272 microversion: 2.1 time: 0.504135 May 23 16:45:42.929556 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 16/30] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:45:42 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1272 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:45:43.198393 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-291879eb-1e5d-4939-a01d-f4daebd6b36f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1455875254", "imageRef": "96972e76-879d-4149-a713-a94529892aad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:45:43.566000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.network.neutron [None req-291879eb-1e5d-4939-a01d-f4daebd6b36f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] validate_networks() for [('480e0590-a5f7-42c2-9f4d-a26535d80892', None, None, None, None, None)] {{(pid=124714) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 16:45:43.954023 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-f1c49e16-3095-4a50-8920-b2c1f4ce2623 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:43.967578 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-f1c49e16-3095-4a50-8920-b2c1f4ce2623 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:44.009642 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f1c49e16-3095-4a50-8920-b2c1f4ce2623 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:44.015566 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f1c49e16-3095-4a50-8920-b2c1f4ce2623 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:44.016370 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f1c49e16-3095-4a50-8920-b2c1f4ce2623 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:44.022569 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f1c49e16-3095-4a50-8920-b2c1f4ce2623 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:44.566070 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=8 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:44.649771 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f1c49e16-3095-4a50-8920-b2c1f4ce2623 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:44.658861 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-f1c49e16-3095-4a50-8920-b2c1f4ce2623 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1272 microversion: 2.1 time: 0.715296 May 23 16:45:44.676821 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 17/31] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:45:43 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1272 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:45:45.703978 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-dc78a538-489b-4c3d-bb51-0fa56038ff0a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:45.705230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-dc78a538-489b-4c3d-bb51-0fa56038ff0a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:45.742652 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dc78a538-489b-4c3d-bb51-0fa56038ff0a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:45.743109 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dc78a538-489b-4c3d-bb51-0fa56038ff0a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:45.743910 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dc78a538-489b-4c3d-bb51-0fa56038ff0a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:45.745098 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dc78a538-489b-4c3d-bb51-0fa56038ff0a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:46.087464 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-dc78a538-489b-4c3d-bb51-0fa56038ff0a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:46.113906 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-dc78a538-489b-4c3d-bb51-0fa56038ff0a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1272 microversion: 2.1 time: 0.409608 May 23 16:45:46.113906 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 18/32] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:45:45 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1272 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:45:46.347256 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-3eac57b0-319f-4e85-a0bf-bdfef3667092 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Action: 'create', calling method: .version_select at 0x7f224d0a5700>, body: {"keypair": {"name": "tempest-keypair-1384241542", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSXcruliiWLEIzoH2Kk1pO0WBc4qGyB5QgJDmx3jbLdq1GKsjcLIZOEufQVKYfBTmxhcLjvu+0xLbdXKDXd1fyLvutssuxnQ1u4xWqrHC59MQrHsDtsYDA42sjbzDHbaA=="}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:45:46.410818 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-3eac57b0-319f-4e85-a0bf-bdfef3667092 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Getting quotas for project 60f9f16bd2494b7999c25509f804d794. Resources: {'key_pairs'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:45:46.430317 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-3eac57b0-319f-4e85-a0bf-bdfef3667092 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Getting quotas for user 29e2a2fa32cd4fb7837bdec1d83cb9da and project 60f9f16bd2494b7999c25509f804d794. Resources: {'key_pairs'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:45:46.656674 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-3eac57b0-319f-4e85-a0bf-bdfef3667092 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.416126 May 23 16:45:46.663241 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 19/33] 10.222.0.74 () {62 vars in 1199 bytes} [Mon May 23 16:45:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 423 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 23 16:45:47.121531 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-334b9e12-46d9-4ef3-912a-8fd64bd4f1c7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:47.123117 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-334b9e12-46d9-4ef3-912a-8fd64bd4f1c7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:47.137119 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-334b9e12-46d9-4ef3-912a-8fd64bd4f1c7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:47.139206 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-334b9e12-46d9-4ef3-912a-8fd64bd4f1c7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:47.140221 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-334b9e12-46d9-4ef3-912a-8fd64bd4f1c7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:47.141289 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-334b9e12-46d9-4ef3-912a-8fd64bd4f1c7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:47.524082 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-291879eb-1e5d-4939-a01d-f4daebd6b36f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Flavor limits 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 16:45:47.524777 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-291879eb-1e5d-4939-a01d-f4daebd6b36f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Image limits 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 16:45:47.525893 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-291879eb-1e5d-4939-a01d-f4daebd6b36f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Flavor pref 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 16:45:47.526365 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-291879eb-1e5d-4939-a01d-f4daebd6b36f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Image pref 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 16:45:47.527184 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-291879eb-1e5d-4939-a01d-f4daebd6b36f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 16:45:47.542000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-291879eb-1e5d-4939-a01d-f4daebd6b36f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:47.546114 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-291879eb-1e5d-4939-a01d-f4daebd6b36f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:47.549100 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-291879eb-1e5d-4939-a01d-f4daebd6b36f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:47.550235 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-291879eb-1e5d-4939-a01d-f4daebd6b36f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:47.584033 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-291879eb-1e5d-4939-a01d-f4daebd6b36f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Getting quotas for project 8c4eba5d39e545cbb8380490c86045f0. Resources: {'cores', 'instances', 'ram'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:45:47.591074 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-291879eb-1e5d-4939-a01d-f4daebd6b36f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Getting quotas for user f14f77bc65fd4ff0bc1ec6de35846f14 and project 8c4eba5d39e545cbb8380490c86045f0. Resources: {'cores', 'instances', 'ram'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:45:47.614452 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-291879eb-1e5d-4939-a01d-f4daebd6b36f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Going to run 1 instances... {{(pid=124714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 16:45:47.624138 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-291879eb-1e5d-4939-a01d-f4daebd6b36f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96972e76-879d-4149-a713-a94529892aad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 16:45:47.898632 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-291879eb-1e5d-4939-a01d-f4daebd6b36f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.828584 May 23 16:45:47.903637 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 15/34] 10.222.0.74 () {60 vars in 1146 bytes} [Mon May 23 16:45:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 4832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 16:45:47.917123 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-e1d5d96f-ce4a-4c99-872f-847c3a9724da tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:47.917776 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-e1d5d96f-ce4a-4c99-872f-847c3a9724da tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:48.203715 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-334b9e12-46d9-4ef3-912a-8fd64bd4f1c7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:48.216474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-334b9e12-46d9-4ef3-912a-8fd64bd4f1c7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1314 microversion: 2.1 time: 1.099564 May 23 16:45:48.217993 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 20/35] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:45:47 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1314 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:45:48.241408 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e1d5d96f-ce4a-4c99-872f-847c3a9724da tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:48.259318 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-e1d5d96f-ce4a-4c99-872f-847c3a9724da tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1222 microversion: 2.1 time: 0.352351 May 23 16:45:48.265033 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 16/36] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:45:47 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1222 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:45:48.693232 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7771f3d6-3370-4dda-a0be-0520d962f923 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1712735249", "imageRef": "96972e76-879d-4149-a713-a94529892aad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:45:48.815555 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.network.neutron [None req-7771f3d6-3370-4dda-a0be-0520d962f923 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] validate_networks() for [('480e0590-a5f7-42c2-9f4d-a26535d80892', None, None, None, None, None)] {{(pid=124715) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 16:45:49.170318 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-c805077b-46e8-4ca8-adb2-cd9860b56623 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Action: 'create', calling method: .version_select at 0x7f224c8a5e50>, body: {"keypair": {"name": "tempest-keypair-1691468904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQ4JMCjJHyir1/gOKdCS3pqatKLLAaSoxxnRLNnVBJmlkwyDwjPJmQRUual8+JHsibQ5q6ege1NfSBd/u0A3hkrwmNIBemOc59KMWD06vgzt77+w2tiTRKf43hAid5R9Q=="}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:45:49.256581 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-c805077b-46e8-4ca8-adb2-cd9860b56623 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Getting quotas for project c14a96662507495b84670e2f62f90f59. Resources: {'key_pairs'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:45:49.278811 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-c805077b-46e8-4ca8-adb2-cd9860b56623 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Getting quotas for user 0e90497b6d9c4a789f6b31680e069087 and project c14a96662507495b84670e2f62f90f59. Resources: {'key_pairs'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:45:49.435327 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-c805077b-46e8-4ca8-adb2-cd9860b56623 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.559385 May 23 16:45:49.442444 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 17/37] 10.222.0.74 () {60 vars in 1158 bytes} [Mon May 23 16:45:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:45:49.467317 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-f23c13ec-ec9c-413d-898f-6e251229fb09 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2060160935", "imageRef": "96972e76-879d-4149-a713-a94529892aad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18a683c4-5441-4a3c-96d0-ecf1b626575e"}], "security_groups": [{"name": "tempest-securitygroup--1161879286"}], "key_name": "tempest-keypair-1659597792", "user_data": "}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:45:50.011881 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.network.neutron [None req-f23c13ec-ec9c-413d-898f-6e251229fb09 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] validate_networks() for [('18a683c4-5441-4a3c-96d0-ecf1b626575e', None, None, None, None, None)] {{(pid=124714) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 16:45:51.941968 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-7771f3d6-3370-4dda-a0be-0520d962f923 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Flavor limits 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 16:45:51.942930 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-7771f3d6-3370-4dda-a0be-0520d962f923 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Image limits 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 16:45:51.943582 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-7771f3d6-3370-4dda-a0be-0520d962f923 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Flavor pref 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 16:45:51.944154 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-7771f3d6-3370-4dda-a0be-0520d962f923 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Image pref 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 16:45:51.944749 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-7771f3d6-3370-4dda-a0be-0520d962f923 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 16:45:51.965333 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7771f3d6-3370-4dda-a0be-0520d962f923 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:51.978591 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7771f3d6-3370-4dda-a0be-0520d962f923 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:51.979333 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7771f3d6-3370-4dda-a0be-0520d962f923 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:51.979775 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7771f3d6-3370-4dda-a0be-0520d962f923 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:52.035465 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-7771f3d6-3370-4dda-a0be-0520d962f923 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Getting quotas for project 8c4eba5d39e545cbb8380490c86045f0. Resources: {'cores', 'instances', 'ram'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:45:52.043766 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-7771f3d6-3370-4dda-a0be-0520d962f923 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Getting quotas for user f14f77bc65fd4ff0bc1ec6de35846f14 and project 8c4eba5d39e545cbb8380490c86045f0. Resources: {'cores', 'instances', 'ram'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:45:52.062570 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-7771f3d6-3370-4dda-a0be-0520d962f923 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Going to run 1 instances... {{(pid=124715) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 16:45:52.067149 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-7771f3d6-3370-4dda-a0be-0520d962f923 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96972e76-879d-4149-a713-a94529892aad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 16:45:52.296847 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-7771f3d6-3370-4dda-a0be-0520d962f923 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.616184 May 23 16:45:52.313334 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 21/38] 10.222.0.74 () {60 vars in 1146 bytes} [Mon May 23 16:45:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 3633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 16:45:52.340224 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e58b6ace-a17f-4bee-a235-e6d6b95c143b tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:52.351954 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e58b6ace-a17f-4bee-a235-e6d6b95c143b tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:52.386748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e58b6ace-a17f-4bee-a235-e6d6b95c143b tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:52.389485 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e58b6ace-a17f-4bee-a235-e6d6b95c143b tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:52.390328 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e58b6ace-a17f-4bee-a235-e6d6b95c143b tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:52.392433 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e58b6ace-a17f-4bee-a235-e6d6b95c143b tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:54.651767 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-f23c13ec-ec9c-413d-898f-6e251229fb09 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Flavor limits 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 16:45:54.652452 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-f23c13ec-ec9c-413d-898f-6e251229fb09 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Image limits 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 16:45:54.653107 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-f23c13ec-ec9c-413d-898f-6e251229fb09 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Flavor pref 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 16:45:54.653542 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-f23c13ec-ec9c-413d-898f-6e251229fb09 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Image pref 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 16:45:54.654698 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-f23c13ec-ec9c-413d-898f-6e251229fb09 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 16:45:54.686205 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f23c13ec-ec9c-413d-898f-6e251229fb09 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:54.688437 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f23c13ec-ec9c-413d-898f-6e251229fb09 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:54.693316 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f23c13ec-ec9c-413d-898f-6e251229fb09 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:54.695502 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f23c13ec-ec9c-413d-898f-6e251229fb09 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:54.767654 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e58b6ace-a17f-4bee-a235-e6d6b95c143b tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:54.782119 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-f23c13ec-ec9c-413d-898f-6e251229fb09 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Getting quotas for project e293f2b3de9143ad9e8a1fe8b67d6641. Resources: {'cores', 'instances', 'ram'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:45:54.792256 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e58b6ace-a17f-4bee-a235-e6d6b95c143b tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1314 microversion: 2.1 time: 2.473444 May 23 16:45:54.806457 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-f23c13ec-ec9c-413d-898f-6e251229fb09 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Getting quotas for user 718a82d2f4294f68965ce01aac0fc166 and project e293f2b3de9143ad9e8a1fe8b67d6641. Resources: {'cores', 'instances', 'ram'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:45:54.807449 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 22/39] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:45:52 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1314 bytes in 2478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:45:54.822988 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-9890480d-22f8-4f26-86d9-aae631859563 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:54.827345 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-9890480d-22f8-4f26-86d9-aae631859563 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:54.851951 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-f23c13ec-ec9c-413d-898f-6e251229fb09 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Going to run 1 instances... {{(pid=124714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 16:45:54.854013 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9890480d-22f8-4f26-86d9-aae631859563 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:54.855097 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9890480d-22f8-4f26-86d9-aae631859563 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:54.860558 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9890480d-22f8-4f26-86d9-aae631859563 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:54.861602 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9890480d-22f8-4f26-86d9-aae631859563 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:54.866678 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-f23c13ec-ec9c-413d-898f-6e251229fb09 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96972e76-879d-4149-a713-a94529892aad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 16:45:55.224480 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-f23c13ec-ec9c-413d-898f-6e251229fb09 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.781311 May 23 16:45:55.224480 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 18/40] 10.222.0.74 () {60 vars in 1146 bytes} [Mon May 23 16:45:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 5787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 16:45:55.247454 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-b065e637-6884-4fa1-bbf2-c24d598d6b2b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1531872474", "imageRef": "96972e76-879d-4149-a713-a94529892aad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c44bb036-b813-45bb-9b92-4ac7d7ecd450"}], "security_groups": [{"name": "tempest-securitygroup--785721982"}], "key_name": "tempest-keypair-1384241542", "user_data": "}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:45:55.327274 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-9890480d-22f8-4f26-86d9-aae631859563 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:55.340215 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-9890480d-22f8-4f26-86d9-aae631859563 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1226 microversion: 2.1 time: 0.529793 May 23 16:45:55.343482 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 23/41] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:45:54 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1226 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:45:55.370332 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-53123cd7-ef71-4eeb-948b-70233991ced1 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:55.370332 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-53123cd7-ef71-4eeb-948b-70233991ced1 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:55.867956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-53123cd7-ef71-4eeb-948b-70233991ced1 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:55.879072 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-53123cd7-ef71-4eeb-948b-70233991ced1 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1242 microversion: 2.1 time: 0.530435 May 23 16:45:55.880798 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 24/42] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:45:55 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1242 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:45:55.976094 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.network.neutron [None req-b065e637-6884-4fa1-bbf2-c24d598d6b2b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] validate_networks() for [('c44bb036-b813-45bb-9b92-4ac7d7ecd450', None, None, None, None, None)] {{(pid=124714) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 16:45:56.007903 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-f719306c-e121-4550-8ca4-762e39f298e2 req-f38d9f5e-6f5f-4c8e-978f-44c19c6d71fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c9f1fc3-3479-44e4-bdbc-702eef9f3920", "tag": "e29253f1-4195-40c3-8e0d-2f6697fb6de0"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:45:56.032854 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-f719306c-e121-4550-8ca4-762e39f298e2 req-f38d9f5e-6f5f-4c8e-978f-44c19c6d71fe service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:56.033310 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-f719306c-e121-4550-8ca4-762e39f298e2 req-f38d9f5e-6f5f-4c8e-978f-44c19c6d71fe service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:56.073869 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-f719306c-e121-4550-8ca4-762e39f298e2 req-f38d9f5e-6f5f-4c8e-978f-44c19c6d71fe service nova] Creating event network-changed:e29253f1-4195-40c3-8e0d-2f6697fb6de0 for instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 on hv-cinder-83925 May 23 16:45:56.074593 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-f719306c-e121-4550-8ca4-762e39f298e2 req-f38d9f5e-6f5f-4c8e-978f-44c19c6d71fe service nova] Acquired lock "compute-rpcapi-router" {{(pid=124715) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 23 16:45:56.076050 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c7fad55a-bc3c-477b-b746-abd77f815361 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:56.076721 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c7fad55a-bc3c-477b-b746-abd77f815361 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:56.077695 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c7fad55a-bc3c-477b-b746-abd77f815361 None None] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:56.078273 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c7fad55a-bc3c-477b-b746-abd77f815361 None None] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:56.121932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.compute.rpcapi [None req-c7fad55a-bc3c-477b-b746-abd77f815361 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 23 16:45:56.122860 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c7fad55a-bc3c-477b-b746-abd77f815361 None None] Releasing lock "compute-rpcapi-router" {{(pid=124715) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 23 16:45:56.155385 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-c7fad55a-bc3c-477b-b746-abd77f815361 None None] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.272907 May 23 16:45:56.156914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 25/43] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:45:56.162559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-0439da88-1ce8-4744-a15e-baaa04c49a88 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:56.163526 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-0439da88-1ce8-4744-a15e-baaa04c49a88 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:56.177307 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0439da88-1ce8-4744-a15e-baaa04c49a88 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:56.182131 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0439da88-1ce8-4744-a15e-baaa04c49a88 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:56.183746 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0439da88-1ce8-4744-a15e-baaa04c49a88 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:56.184388 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0439da88-1ce8-4744-a15e-baaa04c49a88 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:57.369639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-0439da88-1ce8-4744-a15e-baaa04c49a88 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:57.378600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=67 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:57.383901 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-0439da88-1ce8-4744-a15e-baaa04c49a88 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1314 microversion: 2.1 time: 1.225554 May 23 16:45:57.386299 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 26/44] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:45:56 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1314 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:45:57.406960 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-2088c78f-2ea8-4f48-be05-f542b48979d3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:57.407812 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-2088c78f-2ea8-4f48-be05-f542b48979d3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:57.422845 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=7 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:57.426185 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2088c78f-2ea8-4f48-be05-f542b48979d3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:57.428459 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2088c78f-2ea8-4f48-be05-f542b48979d3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:57.429866 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2088c78f-2ea8-4f48-be05-f542b48979d3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:57.432396 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2088c78f-2ea8-4f48-be05-f542b48979d3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:57.585665 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-2088c78f-2ea8-4f48-be05-f542b48979d3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:57.601103 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-2088c78f-2ea8-4f48-be05-f542b48979d3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1292 microversion: 2.1 time: 0.202177 May 23 16:45:57.602533 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 27/45] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:45:57 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1292 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:45:57.622691 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-380464f4-d801-4c39-8e9f-f9a9f0f6f629 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:57.623603 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-380464f4-d801-4c39-8e9f-f9a9f0f6f629 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:57.631113 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-380464f4-d801-4c39-8e9f-f9a9f0f6f629 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:57.631930 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-380464f4-d801-4c39-8e9f-f9a9f0f6f629 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:57.635497 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-380464f4-d801-4c39-8e9f-f9a9f0f6f629 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:57.635497 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-380464f4-d801-4c39-8e9f-f9a9f0f6f629 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:57.826148 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-380464f4-d801-4c39-8e9f-f9a9f0f6f629 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:57.854402 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-380464f4-d801-4c39-8e9f-f9a9f0f6f629 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1246 microversion: 2.1 time: 0.248537 May 23 16:45:57.867974 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 28/46] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:45:57 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1246 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:45:57.971449 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-b065e637-6884-4fa1-bbf2-c24d598d6b2b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Flavor limits 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 16:45:57.971928 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-b065e637-6884-4fa1-bbf2-c24d598d6b2b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Image limits 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 16:45:57.972560 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-b065e637-6884-4fa1-bbf2-c24d598d6b2b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Flavor pref 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 16:45:57.973154 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-b065e637-6884-4fa1-bbf2-c24d598d6b2b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Image pref 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 16:45:57.973717 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-b065e637-6884-4fa1-bbf2-c24d598d6b2b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 16:45:58.013220 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b065e637-6884-4fa1-bbf2-c24d598d6b2b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:58.013790 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b065e637-6884-4fa1-bbf2-c24d598d6b2b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:58.017152 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b065e637-6884-4fa1-bbf2-c24d598d6b2b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:58.017614 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b065e637-6884-4fa1-bbf2-c24d598d6b2b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:58.125397 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-b065e637-6884-4fa1-bbf2-c24d598d6b2b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Getting quotas for project 60f9f16bd2494b7999c25509f804d794. Resources: {'cores', 'instances', 'ram'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:45:58.139753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-b065e637-6884-4fa1-bbf2-c24d598d6b2b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Getting quotas for user 29e2a2fa32cd4fb7837bdec1d83cb9da and project 60f9f16bd2494b7999c25509f804d794. Resources: {'cores', 'instances', 'ram'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:45:58.186553 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-b065e637-6884-4fa1-bbf2-c24d598d6b2b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Going to run 1 instances... {{(pid=124714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 16:45:58.191577 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-b065e637-6884-4fa1-bbf2-c24d598d6b2b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96972e76-879d-4149-a713-a94529892aad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 16:45:58.402858 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-9d613be4-2a05-4438-b02f-670c3d717e57 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:58.403472 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-9d613be4-2a05-4438-b02f-670c3d717e57 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:58.413648 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9d613be4-2a05-4438-b02f-670c3d717e57 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:58.414382 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9d613be4-2a05-4438-b02f-670c3d717e57 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:58.416607 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9d613be4-2a05-4438-b02f-670c3d717e57 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:58.422972 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9d613be4-2a05-4438-b02f-670c3d717e57 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:58.489362 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-b065e637-6884-4fa1-bbf2-c24d598d6b2b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.248499 May 23 16:45:58.495709 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 19/47] 10.222.0.74 () {62 vars in 1187 bytes} [Mon May 23 16:45:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 3271 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 23 16:45:58.536847 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-cb47a074-51f1-454b-8ca5-abbfe1f84d6b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:58.539635 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-cb47a074-51f1-454b-8ca5-abbfe1f84d6b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:58.895661 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-cb47a074-51f1-454b-8ca5-abbfe1f84d6b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:58.918659 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-cb47a074-51f1-454b-8ca5-abbfe1f84d6b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:58.925807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-cb47a074-51f1-454b-8ca5-abbfe1f84d6b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:58.934824 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-cb47a074-51f1-454b-8ca5-abbfe1f84d6b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1282 microversion: 2.20 time: 0.428536 May 23 16:45:58.965264 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 20/48] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:45:58 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1282 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:45:58.981732 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-9c033791-66ba-4ce4-b7a6-6a4660126326 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:58.983330 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-9c033791-66ba-4ce4-b7a6-6a4660126326 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:58.991869 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9c033791-66ba-4ce4-b7a6-6a4660126326 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:58.992810 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9c033791-66ba-4ce4-b7a6-6a4660126326 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:58.993839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9c033791-66ba-4ce4-b7a6-6a4660126326 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:58.994562 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9c033791-66ba-4ce4-b7a6-6a4660126326 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:59.060280 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=19 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:59.779958 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-9c033791-66ba-4ce4-b7a6-6a4660126326 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:59.779958 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-9c033791-66ba-4ce4-b7a6-6a4660126326 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1280 microversion: 2.1 time: 0.799600 May 23 16:45:59.779958 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 21/49] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:45:58 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1280 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:45:59.779958 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-3aa0d8b0-c1eb-4d7b-88b2-37c8871a5445 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:59.780566 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-3aa0d8b0-c1eb-4d7b-88b2-37c8871a5445 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:59.780566 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:45:59.780566 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3aa0d8b0-c1eb-4d7b-88b2-37c8871a5445 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:59.816362 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3aa0d8b0-c1eb-4d7b-88b2-37c8871a5445 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:59.817671 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3aa0d8b0-c1eb-4d7b-88b2-37c8871a5445 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:45:59.817885 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-9d613be4-2a05-4438-b02f-670c3d717e57 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:45:59.820807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3aa0d8b0-c1eb-4d7b-88b2-37c8871a5445 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:45:59.826552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-9d613be4-2a05-4438-b02f-670c3d717e57 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1314 microversion: 2.1 time: 1.428244 May 23 16:45:59.836362 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 29/50] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:45:58 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1314 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:45:59.954529 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-cc279550-e327-40b3-8f45-5c4bb1ff77fb tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:45:59.955181 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-cc279550-e327-40b3-8f45-5c4bb1ff77fb tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:45:59.999146 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-3aa0d8b0-c1eb-4d7b-88b2-37c8871a5445 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:00.025535 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-3aa0d8b0-c1eb-4d7b-88b2-37c8871a5445 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1302 microversion: 2.1 time: 0.247182 May 23 16:46:00.025535 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 22/51] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:45:59 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1302 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:00.065481 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-cc279550-e327-40b3-8f45-5c4bb1ff77fb tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:00.081452 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-cc279550-e327-40b3-8f45-5c4bb1ff77fb tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:00.083757 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-cc279550-e327-40b3-8f45-5c4bb1ff77fb tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:00.085349 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-cc279550-e327-40b3-8f45-5c4bb1ff77fb tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1282 microversion: 2.20 time: 0.135596 May 23 16:46:00.097293 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 30/52] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:45:59 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1282 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:46:00.795988 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-c7d380b6-6eae-4b13-a4bb-0581f4cc4098 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:00.796843 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-c7d380b6-6eae-4b13-a4bb-0581f4cc4098 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:00.807316 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c7d380b6-6eae-4b13-a4bb-0581f4cc4098 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:00.807316 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c7d380b6-6eae-4b13-a4bb-0581f4cc4098 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:00.807316 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c7d380b6-6eae-4b13-a4bb-0581f4cc4098 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:00.807316 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c7d380b6-6eae-4b13-a4bb-0581f4cc4098 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:00.845547 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-6d62982d-8c16-4890-9095-6fb72a54f9a9 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:00.846173 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-6d62982d-8c16-4890-9095-6fb72a54f9a9 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:00.855726 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6d62982d-8c16-4890-9095-6fb72a54f9a9 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:00.856499 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6d62982d-8c16-4890-9095-6fb72a54f9a9 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:00.863025 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6d62982d-8c16-4890-9095-6fb72a54f9a9 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:00.863690 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6d62982d-8c16-4890-9095-6fb72a54f9a9 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:00.884717 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-c7d380b6-6eae-4b13-a4bb-0581f4cc4098 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:00.894698 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-c7d380b6-6eae-4b13-a4bb-0581f4cc4098 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1280 microversion: 2.1 time: 0.102760 May 23 16:46:00.896222 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 23/53] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:00 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1280 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:01.034786 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-92a05b36-128d-450d-af36-e72a4fe69dac tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:01.036839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-92a05b36-128d-450d-af36-e72a4fe69dac tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:01.047301 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-92a05b36-128d-450d-af36-e72a4fe69dac tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:01.050028 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-92a05b36-128d-450d-af36-e72a4fe69dac tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:01.053456 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-92a05b36-128d-450d-af36-e72a4fe69dac tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:01.061196 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-92a05b36-128d-450d-af36-e72a4fe69dac tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:01.079235 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-6d62982d-8c16-4890-9095-6fb72a54f9a9 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:01.091208 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-6d62982d-8c16-4890-9095-6fb72a54f9a9 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1314 microversion: 2.1 time: 0.249691 May 23 16:46:01.098638 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 31/54] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:00 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:01.105716 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c1f69bb3-cb0b-4290-97e7-3ee040eaa70a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-134903035", "imageRef": "96972e76-879d-4149-a713-a94529892aad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "947fccc6-85b5-4119-b9b2-40d0d2bd9aac"}], "security_groups": [{"name": "tempest-securitygroup--1687658872"}], "key_name": "tempest-keypair-1691468904", "user_data": "}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:46:01.155966 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-92a05b36-128d-450d-af36-e72a4fe69dac tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:01.167263 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-92a05b36-128d-450d-af36-e72a4fe69dac tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1300 microversion: 2.1 time: 0.137687 May 23 16:46:01.168829 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 24/55] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:01 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1300 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:01.178422 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-b0615ee9-f122-4428-96d8-227ff3ebe3a8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:01.179313 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-b0615ee9-f122-4428-96d8-227ff3ebe3a8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:01.187061 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b0615ee9-f122-4428-96d8-227ff3ebe3a8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:01.187725 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b0615ee9-f122-4428-96d8-227ff3ebe3a8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:01.188962 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b0615ee9-f122-4428-96d8-227ff3ebe3a8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:01.208127 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b0615ee9-f122-4428-96d8-227ff3ebe3a8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:01.319596 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.network.neutron [None req-c1f69bb3-cb0b-4290-97e7-3ee040eaa70a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] validate_networks() for [('947fccc6-85b5-4119-b9b2-40d0d2bd9aac', None, None, None, None, None)] {{(pid=124715) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 16:46:01.327261 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b0615ee9-f122-4428-96d8-227ff3ebe3a8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:01.338970 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b0615ee9-f122-4428-96d8-227ff3ebe3a8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:01.340557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b0615ee9-f122-4428-96d8-227ff3ebe3a8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:01.341744 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-b0615ee9-f122-4428-96d8-227ff3ebe3a8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1286 microversion: 2.20 time: 0.171656 May 23 16:46:01.347969 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 25/56] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:01 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1286 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:46:01.915650 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-bb678f14-0371-4956-bfc6-67cd8aa029a5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:01.916317 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-bb678f14-0371-4956-bfc6-67cd8aa029a5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:01.931605 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bb678f14-0371-4956-bfc6-67cd8aa029a5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:01.935371 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bb678f14-0371-4956-bfc6-67cd8aa029a5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:01.936494 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bb678f14-0371-4956-bfc6-67cd8aa029a5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:01.938924 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bb678f14-0371-4956-bfc6-67cd8aa029a5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:02.776723 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-bb678f14-0371-4956-bfc6-67cd8aa029a5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:02.783160 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-c1f69bb3-cb0b-4290-97e7-3ee040eaa70a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Flavor limits 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 16:46:02.784910 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-c1f69bb3-cb0b-4290-97e7-3ee040eaa70a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Image limits 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 16:46:02.785578 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-c1f69bb3-cb0b-4290-97e7-3ee040eaa70a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Flavor pref 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 16:46:02.786860 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-c1f69bb3-cb0b-4290-97e7-3ee040eaa70a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Image pref 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 16:46:02.787544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-c1f69bb3-cb0b-4290-97e7-3ee040eaa70a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 16:46:02.791606 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-bb678f14-0371-4956-bfc6-67cd8aa029a5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1322 microversion: 2.1 time: 0.879795 May 23 16:46:02.794109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 26/57] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:01 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1322 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:02.802240 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-4af090c2-9162-498c-a5ab-58eb6023b061 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:02.803025 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-4af090c2-9162-498c-a5ab-58eb6023b061 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:02.804033 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c1f69bb3-cb0b-4290-97e7-3ee040eaa70a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:02.804872 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c1f69bb3-cb0b-4290-97e7-3ee040eaa70a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:02.806693 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c1f69bb3-cb0b-4290-97e7-3ee040eaa70a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:02.807597 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c1f69bb3-cb0b-4290-97e7-3ee040eaa70a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:02.810734 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4af090c2-9162-498c-a5ab-58eb6023b061 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:02.816033 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4af090c2-9162-498c-a5ab-58eb6023b061 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:02.817263 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4af090c2-9162-498c-a5ab-58eb6023b061 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:02.817866 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4af090c2-9162-498c-a5ab-58eb6023b061 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:02.833522 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-c1f69bb3-cb0b-4290-97e7-3ee040eaa70a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Getting quotas for project c14a96662507495b84670e2f62f90f59. Resources: {'cores', 'instances', 'ram'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:46:02.841835 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-c1f69bb3-cb0b-4290-97e7-3ee040eaa70a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Getting quotas for user 0e90497b6d9c4a789f6b31680e069087 and project c14a96662507495b84670e2f62f90f59. Resources: {'cores', 'instances', 'ram'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:46:02.856877 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-c1f69bb3-cb0b-4290-97e7-3ee040eaa70a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Going to run 1 instances... {{(pid=124715) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 16:46:02.859769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-c1f69bb3-cb0b-4290-97e7-3ee040eaa70a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96972e76-879d-4149-a713-a94529892aad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 16:46:03.002211 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-4af090c2-9162-498c-a5ab-58eb6023b061 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:03.013181 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-4af090c2-9162-498c-a5ab-58eb6023b061 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1314 microversion: 2.1 time: 0.217882 May 23 16:46:03.015685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 27/58] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:02 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:03.026808 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-c1f69bb3-cb0b-4290-97e7-3ee040eaa70a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.926118 May 23 16:46:03.034898 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 32/59] 10.222.0.74 () {60 vars in 1146 bytes} [Mon May 23 16:46:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 1935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 16:46:03.038407 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-4d0ef30c-2d57-4b5e-a4a4-eb0c9d2488e2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:03.040282 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-4d0ef30c-2d57-4b5e-a4a4-eb0c9d2488e2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:03.041036 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-b52d5c41-57ab-41f5-a9b6-85f74997dd9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:03.041880 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-b52d5c41-57ab-41f5-a9b6-85f74997dd9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:03.049753 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b52d5c41-57ab-41f5-a9b6-85f74997dd9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:03.050416 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b52d5c41-57ab-41f5-a9b6-85f74997dd9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:03.051806 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b52d5c41-57ab-41f5-a9b6-85f74997dd9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:03.052556 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b52d5c41-57ab-41f5-a9b6-85f74997dd9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:03.093750 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4d0ef30c-2d57-4b5e-a4a4-eb0c9d2488e2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:03.094446 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4d0ef30c-2d57-4b5e-a4a4-eb0c9d2488e2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:03.095960 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4d0ef30c-2d57-4b5e-a4a4-eb0c9d2488e2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:03.097035 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4d0ef30c-2d57-4b5e-a4a4-eb0c9d2488e2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:03.279778 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-b52d5c41-57ab-41f5-a9b6-85f74997dd9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:03.295231 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-b52d5c41-57ab-41f5-a9b6-85f74997dd9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:03.299744 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-b52d5c41-57ab-41f5-a9b6-85f74997dd9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:03.304422 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-b52d5c41-57ab-41f5-a9b6-85f74997dd9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1278 microversion: 2.20 time: 0.267994 May 23 16:46:03.307503 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 33/60] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:03 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1278 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:46:03.319529 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-0ffb7eb0-6b73-4fe1-ba5c-246a783233f3 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:03.326764 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-0ffb7eb0-6b73-4fe1-ba5c-246a783233f3 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:03.355185 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-4d0ef30c-2d57-4b5e-a4a4-eb0c9d2488e2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:03.362639 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-4d0ef30c-2d57-4b5e-a4a4-eb0c9d2488e2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1368 microversion: 2.1 time: 0.337746 May 23 16:46:03.378998 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 28/61] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:03 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1368 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:03.420979 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-0ffb7eb0-6b73-4fe1-ba5c-246a783233f3 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:03.437342 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-0ffb7eb0-6b73-4fe1-ba5c-246a783233f3 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1237 microversion: 2.1 time: 0.124028 May 23 16:46:03.437934 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 34/62] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:03 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1237 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:03.711490 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-5d812489-9917-4a1c-a07a-2074380cb94e req-6a978f79-71dd-4749-ba9a-a2b87324da9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ff57504-04ce-414c-b676-fb6bcec4cccf", "tag": "a89d6674-fb70-4453-b26a-4eb162b70152"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:46:03.744628 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-5d812489-9917-4a1c-a07a-2074380cb94e req-6a978f79-71dd-4749-ba9a-a2b87324da9f service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:03.745346 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-5d812489-9917-4a1c-a07a-2074380cb94e req-6a978f79-71dd-4749-ba9a-a2b87324da9f service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:03.778977 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-5d812489-9917-4a1c-a07a-2074380cb94e req-6a978f79-71dd-4749-ba9a-a2b87324da9f service nova] Creating event network-changed:a89d6674-fb70-4453-b26a-4eb162b70152 for instance 2ff57504-04ce-414c-b676-fb6bcec4cccf on hv-cinder-83925 May 23 16:46:03.783208 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-5d812489-9917-4a1c-a07a-2074380cb94e req-6a978f79-71dd-4749-ba9a-a2b87324da9f service nova] Acquired lock "compute-rpcapi-router" {{(pid=124714) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 23 16:46:03.783208 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-347451b1-7926-4c53-b757-778e87e74648 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:03.783208 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-347451b1-7926-4c53-b757-778e87e74648 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:03.783208 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-347451b1-7926-4c53-b757-778e87e74648 None None] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:03.783208 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-347451b1-7926-4c53-b757-778e87e74648 None None] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:03.794041 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.compute.rpcapi [None req-347451b1-7926-4c53-b757-778e87e74648 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 23 16:46:03.795116 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-347451b1-7926-4c53-b757-778e87e74648 None None] Releasing lock "compute-rpcapi-router" {{(pid=124714) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 23 16:46:03.811807 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-47ef8bdd-1221-4d15-b60c-a44999f72a08 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:03.815591 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-47ef8bdd-1221-4d15-b60c-a44999f72a08 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:03.818666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-347451b1-7926-4c53-b757-778e87e74648 None None] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111682 May 23 16:46:03.819263 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 29/63] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:46:03.827879 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-47ef8bdd-1221-4d15-b60c-a44999f72a08 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:03.828728 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-47ef8bdd-1221-4d15-b60c-a44999f72a08 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:03.829589 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-47ef8bdd-1221-4d15-b60c-a44999f72a08 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:03.830109 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-47ef8bdd-1221-4d15-b60c-a44999f72a08 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:03.998453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-47ef8bdd-1221-4d15-b60c-a44999f72a08 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:04.007414 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-47ef8bdd-1221-4d15-b60c-a44999f72a08 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1322 microversion: 2.1 time: 0.200811 May 23 16:46:04.007995 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 35/64] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:03 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:04.031779 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ec541a8f-c808-4b30-bad2-9be531d661e6 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:04.032674 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ec541a8f-c808-4b30-bad2-9be531d661e6 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:04.043673 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ec541a8f-c808-4b30-bad2-9be531d661e6 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:04.044454 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ec541a8f-c808-4b30-bad2-9be531d661e6 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:04.045557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ec541a8f-c808-4b30-bad2-9be531d661e6 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:04.046157 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ec541a8f-c808-4b30-bad2-9be531d661e6 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:04.334277 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ec541a8f-c808-4b30-bad2-9be531d661e6 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:04.349382 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ec541a8f-c808-4b30-bad2-9be531d661e6 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1314 microversion: 2.1 time: 0.321784 May 23 16:46:04.350007 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 30/65] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:04 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:04.357510 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-1e057a08-a6fc-46c0-ac1f-e52d74d0431a req-e811ad16-136c-4cdf-bf32-8dcda1bccb1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff5e6ec2-b063-4631-9582-9d94a739d3b7", "tag": "e6e977d2-2ea9-45e2-bc52-5193a7346b82"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:46:04.366893 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-531d87d1-61f7-4d30-8647-9e669029b187 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:04.367522 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-531d87d1-61f7-4d30-8647-9e669029b187 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:04.377500 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-531d87d1-61f7-4d30-8647-9e669029b187 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:04.377966 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-531d87d1-61f7-4d30-8647-9e669029b187 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:04.378769 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-531d87d1-61f7-4d30-8647-9e669029b187 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:04.379242 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-531d87d1-61f7-4d30-8647-9e669029b187 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:04.381127 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-1e057a08-a6fc-46c0-ac1f-e52d74d0431a req-e811ad16-136c-4cdf-bf32-8dcda1bccb1d service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:04.381979 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-1e057a08-a6fc-46c0-ac1f-e52d74d0431a req-e811ad16-136c-4cdf-bf32-8dcda1bccb1d service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:04.425437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-1e057a08-a6fc-46c0-ac1f-e52d74d0431a req-e811ad16-136c-4cdf-bf32-8dcda1bccb1d service nova] Creating event network-changed:e6e977d2-2ea9-45e2-bc52-5193a7346b82 for instance ff5e6ec2-b063-4631-9582-9d94a739d3b7 on hv-cinder-83925 May 23 16:46:04.443731 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-1e057a08-a6fc-46c0-ac1f-e52d74d0431a req-e811ad16-136c-4cdf-bf32-8dcda1bccb1d service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184567 May 23 16:46:04.451403 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 36/66] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:46:04.458941 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-9c604ddf-1eaa-4ef3-9f20-6cd5a6e76f8e tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:04.460666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-531d87d1-61f7-4d30-8647-9e669029b187 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:04.461168 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-9c604ddf-1eaa-4ef3-9f20-6cd5a6e76f8e tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:04.475540 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9c604ddf-1eaa-4ef3-9f20-6cd5a6e76f8e tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:04.476151 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9c604ddf-1eaa-4ef3-9f20-6cd5a6e76f8e tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:04.477065 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9c604ddf-1eaa-4ef3-9f20-6cd5a6e76f8e tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:04.477642 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9c604ddf-1eaa-4ef3-9f20-6cd5a6e76f8e tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:04.485187 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-531d87d1-61f7-4d30-8647-9e669029b187 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:04.486828 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-531d87d1-61f7-4d30-8647-9e669029b187 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:04.487891 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-531d87d1-61f7-4d30-8647-9e669029b187 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1278 microversion: 2.20 time: 0.136718 May 23 16:46:04.490705 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 31/67] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:04 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1278 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:46:04.498073 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-0f762e54-8069-46a3-b9bf-50adc8df204f tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:04.498924 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-0f762e54-8069-46a3-b9bf-50adc8df204f tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:04.580655 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-0f762e54-8069-46a3-b9bf-50adc8df204f tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:04.584059 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=35 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:04.588821 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-0f762e54-8069-46a3-b9bf-50adc8df204f tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1237 microversion: 2.1 time: 0.096812 May 23 16:46:04.589547 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 32/68] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:04 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1237 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:04.664423 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-9c604ddf-1eaa-4ef3-9f20-6cd5a6e76f8e tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:04.672590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-9c604ddf-1eaa-4ef3-9f20-6cd5a6e76f8e tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1368 microversion: 2.1 time: 0.218571 May 23 16:46:04.673169 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 37/69] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:04 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:05.030991 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-d1853b30-f875-4f7c-8bbf-bd2364b53c43 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:05.031841 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-d1853b30-f875-4f7c-8bbf-bd2364b53c43 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:05.043435 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d1853b30-f875-4f7c-8bbf-bd2364b53c43 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:05.052403 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d1853b30-f875-4f7c-8bbf-bd2364b53c43 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:05.054632 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d1853b30-f875-4f7c-8bbf-bd2364b53c43 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:05.055200 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d1853b30-f875-4f7c-8bbf-bd2364b53c43 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:05.366450 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-95124dec-4397-4642-b05a-3bf8448514e1 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:05.367074 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-95124dec-4397-4642-b05a-3bf8448514e1 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:05.374423 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-95124dec-4397-4642-b05a-3bf8448514e1 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:05.375106 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-95124dec-4397-4642-b05a-3bf8448514e1 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:05.376047 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-95124dec-4397-4642-b05a-3bf8448514e1 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:05.376671 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-95124dec-4397-4642-b05a-3bf8448514e1 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:05.744572 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-d1853b30-f875-4f7c-8bbf-bd2364b53c43 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:05.757960 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-d1853b30-f875-4f7c-8bbf-bd2364b53c43 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1322 microversion: 2.1 time: 0.735471 May 23 16:46:05.758555 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 33/70] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:05 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1322 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:05.766047 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-2a18f2e1-303e-4509-876d-509a92f2e7e7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:05.766981 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-2a18f2e1-303e-4509-876d-509a92f2e7e7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:05.773681 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2a18f2e1-303e-4509-876d-509a92f2e7e7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:05.774286 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2a18f2e1-303e-4509-876d-509a92f2e7e7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:05.776635 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2a18f2e1-303e-4509-876d-509a92f2e7e7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:05.777161 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2a18f2e1-303e-4509-876d-509a92f2e7e7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:05.845199 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-95124dec-4397-4642-b05a-3bf8448514e1 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:05.852773 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-95124dec-4397-4642-b05a-3bf8448514e1 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1314 microversion: 2.1 time: 0.490036 May 23 16:46:05.853572 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 38/71] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:05 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:05.858159 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-b1d74643-a4a2-4a7d-9791-b246ffffa308 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:05.858942 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-b1d74643-a4a2-4a7d-9791-b246ffffa308 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:05.867804 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b1d74643-a4a2-4a7d-9791-b246ffffa308 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:05.868762 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b1d74643-a4a2-4a7d-9791-b246ffffa308 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:05.869707 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b1d74643-a4a2-4a7d-9791-b246ffffa308 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:05.870323 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b1d74643-a4a2-4a7d-9791-b246ffffa308 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:05.872276 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-2a18f2e1-303e-4509-876d-509a92f2e7e7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:05.882283 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-2a18f2e1-303e-4509-876d-509a92f2e7e7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:05.885198 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-2a18f2e1-303e-4509-876d-509a92f2e7e7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:05.886439 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-2a18f2e1-303e-4509-876d-509a92f2e7e7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1278 microversion: 2.20 time: 0.125545 May 23 16:46:05.896394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 34/72] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:05 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1278 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:46:05.896394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-33d35d16-40c5-40a5-b2e5-cf32d67636b7 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:05.896394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-33d35d16-40c5-40a5-b2e5-cf32d67636b7 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:05.900452 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-33d35d16-40c5-40a5-b2e5-cf32d67636b7 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:05.900834 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-33d35d16-40c5-40a5-b2e5-cf32d67636b7 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:05.901652 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-33d35d16-40c5-40a5-b2e5-cf32d67636b7 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:05.902095 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-33d35d16-40c5-40a5-b2e5-cf32d67636b7 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:05.953793 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-b1d74643-a4a2-4a7d-9791-b246ffffa308 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:05.962828 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-b1d74643-a4a2-4a7d-9791-b246ffffa308 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1241 microversion: 2.1 time: 0.107543 May 23 16:46:05.963630 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 39/73] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:05 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1241 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:06.175112 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-33d35d16-40c5-40a5-b2e5-cf32d67636b7 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:06.187749 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-33d35d16-40c5-40a5-b2e5-cf32d67636b7 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1368 microversion: 2.1 time: 0.299233 May 23 16:46:06.188567 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 35/74] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:05 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1368 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:06.775091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-6de4dd82-ac61-4ccc-882f-97df2e2b73d6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:06.775744 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-6de4dd82-ac61-4ccc-882f-97df2e2b73d6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:06.783550 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6de4dd82-ac61-4ccc-882f-97df2e2b73d6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:06.786353 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6de4dd82-ac61-4ccc-882f-97df2e2b73d6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:06.787417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6de4dd82-ac61-4ccc-882f-97df2e2b73d6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:06.788030 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6de4dd82-ac61-4ccc-882f-97df2e2b73d6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:06.853064 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-82440335-4acc-4a4c-ba35-41397adcd26e req-f12268d1-532b-4166-8d3a-ec90c2b4f745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ead45718-a5be-4d14-a83c-b6101b5ebc3c", "tag": "9b6b2933-3180-4c87-a5e7-c75a56eb9704"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:46:06.870755 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-82440335-4acc-4a4c-ba35-41397adcd26e req-f12268d1-532b-4166-8d3a-ec90c2b4f745 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:06.871441 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-82440335-4acc-4a4c-ba35-41397adcd26e req-f12268d1-532b-4166-8d3a-ec90c2b4f745 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:06.907845 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-82440335-4acc-4a4c-ba35-41397adcd26e req-f12268d1-532b-4166-8d3a-ec90c2b4f745 service nova] Creating event network-changed:9b6b2933-3180-4c87-a5e7-c75a56eb9704 for instance ead45718-a5be-4d14-a83c-b6101b5ebc3c on hv-cinder-83925 May 23 16:46:06.920036 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-82440335-4acc-4a4c-ba35-41397adcd26e req-f12268d1-532b-4166-8d3a-ec90c2b4f745 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074143 May 23 16:46:06.925614 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 36/75] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:46:06.937310 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-4f578782-a60b-4662-8b9e-be05ef3dc4fe tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:06.940742 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-4f578782-a60b-4662-8b9e-be05ef3dc4fe tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:06.950198 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4f578782-a60b-4662-8b9e-be05ef3dc4fe tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:06.953825 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4f578782-a60b-4662-8b9e-be05ef3dc4fe tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:06.953825 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4f578782-a60b-4662-8b9e-be05ef3dc4fe tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:06.953825 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4f578782-a60b-4662-8b9e-be05ef3dc4fe tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:07.016759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-6de4dd82-ac61-4ccc-882f-97df2e2b73d6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:07.026952 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-6de4dd82-ac61-4ccc-882f-97df2e2b73d6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1322 microversion: 2.1 time: 0.255569 May 23 16:46:07.027543 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 40/76] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:06 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:07.033578 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-5195cf7a-cc7a-450d-8ad9-c73c8b81f900 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:07.034619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-5195cf7a-cc7a-450d-8ad9-c73c8b81f900 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:07.045393 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5195cf7a-cc7a-450d-8ad9-c73c8b81f900 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:07.046063 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5195cf7a-cc7a-450d-8ad9-c73c8b81f900 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:07.047081 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5195cf7a-cc7a-450d-8ad9-c73c8b81f900 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:07.047725 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5195cf7a-cc7a-450d-8ad9-c73c8b81f900 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:07.129289 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-5195cf7a-cc7a-450d-8ad9-c73c8b81f900 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:07.137935 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-5195cf7a-cc7a-450d-8ad9-c73c8b81f900 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:07.139431 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-5195cf7a-cc7a-450d-8ad9-c73c8b81f900 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:07.140563 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-5195cf7a-cc7a-450d-8ad9-c73c8b81f900 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1334 microversion: 2.20 time: 0.111345 May 23 16:46:07.141122 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 41/77] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:07 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1334 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:46:07.145625 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-b451079d-295f-41a2-aee0-dc0f3f407618 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:07.146231 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-b451079d-295f-41a2-aee0-dc0f3f407618 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:07.146365 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-4f578782-a60b-4662-8b9e-be05ef3dc4fe tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:07.153965 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b451079d-295f-41a2-aee0-dc0f3f407618 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:07.154412 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b451079d-295f-41a2-aee0-dc0f3f407618 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:07.155191 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b451079d-295f-41a2-aee0-dc0f3f407618 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:07.155622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b451079d-295f-41a2-aee0-dc0f3f407618 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:07.159735 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-4f578782-a60b-4662-8b9e-be05ef3dc4fe tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1314 microversion: 2.1 time: 0.231825 May 23 16:46:07.161105 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 37/78] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:06 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:07.217525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-258171c4-8110-4159-b959-70d51237e21d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:07.218210 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-258171c4-8110-4159-b959-70d51237e21d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:07.232096 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-258171c4-8110-4159-b959-70d51237e21d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:07.232096 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-258171c4-8110-4159-b959-70d51237e21d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:07.232096 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-258171c4-8110-4159-b959-70d51237e21d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:07.232096 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-258171c4-8110-4159-b959-70d51237e21d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:07.241103 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-b451079d-295f-41a2-aee0-dc0f3f407618 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:07.249232 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-b451079d-295f-41a2-aee0-dc0f3f407618 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1289 microversion: 2.1 time: 0.107124 May 23 16:46:07.249809 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 42/79] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:07 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1289 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:07.378529 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-258171c4-8110-4159-b959-70d51237e21d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:07.386620 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-258171c4-8110-4159-b959-70d51237e21d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1368 microversion: 2.1 time: 0.181791 May 23 16:46:07.387197 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 38/80] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:07 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:08.044287 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-6b800c92-17bd-477a-ba9f-32e7252282c0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:08.044930 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-6b800c92-17bd-477a-ba9f-32e7252282c0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:08.050858 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6b800c92-17bd-477a-ba9f-32e7252282c0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:08.051307 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6b800c92-17bd-477a-ba9f-32e7252282c0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:08.052069 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6b800c92-17bd-477a-ba9f-32e7252282c0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:08.052554 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6b800c92-17bd-477a-ba9f-32e7252282c0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:08.185186 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-0fd3a95f-bdfc-488e-892e-763319904206 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:08.185186 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-0fd3a95f-bdfc-488e-892e-763319904206 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:08.185186 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0fd3a95f-bdfc-488e-892e-763319904206 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:08.185186 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0fd3a95f-bdfc-488e-892e-763319904206 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:08.185614 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0fd3a95f-bdfc-488e-892e-763319904206 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:08.185614 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0fd3a95f-bdfc-488e-892e-763319904206 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:08.228508 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-6b800c92-17bd-477a-ba9f-32e7252282c0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:08.235618 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-6b800c92-17bd-477a-ba9f-32e7252282c0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1322 microversion: 2.1 time: 0.195303 May 23 16:46:08.236278 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 43/81] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:08 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:08.242003 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-146f2729-8a31-4bc0-9331-5245de436364 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:08.243075 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-146f2729-8a31-4bc0-9331-5245de436364 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:08.249338 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-146f2729-8a31-4bc0-9331-5245de436364 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:08.249918 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-146f2729-8a31-4bc0-9331-5245de436364 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:08.254434 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-146f2729-8a31-4bc0-9331-5245de436364 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:08.254434 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-146f2729-8a31-4bc0-9331-5245de436364 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:08.289886 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-0fd3a95f-bdfc-488e-892e-763319904206 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:08.293629 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=100 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:08.303487 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-0fd3a95f-bdfc-488e-892e-763319904206 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:08.305570 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-0fd3a95f-bdfc-488e-892e-763319904206 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:08.307449 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-0fd3a95f-bdfc-488e-892e-763319904206 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1334 microversion: 2.20 time: 0.151829 May 23 16:46:08.308995 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 39/82] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:08 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1334 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:46:08.315507 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-239ef790-cd1d-4743-8a09-9798f63edcc5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:08.316421 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-239ef790-cd1d-4743-8a09-9798f63edcc5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:08.325752 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-239ef790-cd1d-4743-8a09-9798f63edcc5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:08.326296 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-239ef790-cd1d-4743-8a09-9798f63edcc5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:08.327493 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-239ef790-cd1d-4743-8a09-9798f63edcc5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:08.328418 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-239ef790-cd1d-4743-8a09-9798f63edcc5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:08.424065 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-239ef790-cd1d-4743-8a09-9798f63edcc5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:08.432629 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-239ef790-cd1d-4743-8a09-9798f63edcc5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1289 microversion: 2.1 time: 0.122464 May 23 16:46:08.433397 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 40/83] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:08 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1289 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:08.438635 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-8353e5f3-105d-488a-be24-fc280ddfd7df tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:08.439518 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-8353e5f3-105d-488a-be24-fc280ddfd7df tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:08.445823 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8353e5f3-105d-488a-be24-fc280ddfd7df tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:08.447164 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8353e5f3-105d-488a-be24-fc280ddfd7df tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:08.448277 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8353e5f3-105d-488a-be24-fc280ddfd7df tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:08.448939 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8353e5f3-105d-488a-be24-fc280ddfd7df tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:08.461190 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-146f2729-8a31-4bc0-9331-5245de436364 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:08.471090 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-146f2729-8a31-4bc0-9331-5245de436364 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1314 microversion: 2.1 time: 0.233696 May 23 16:46:08.472369 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 44/84] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:08 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:08.606612 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8353e5f3-105d-488a-be24-fc280ddfd7df tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:08.613769 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-8353e5f3-105d-488a-be24-fc280ddfd7df tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1368 microversion: 2.1 time: 0.178917 May 23 16:46:08.622966 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 41/85] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:08 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:09.255357 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-cc1110fe-2222-4d5b-84d8-a968331b8e23 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:09.256803 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-cc1110fe-2222-4d5b-84d8-a968331b8e23 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:09.271199 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cc1110fe-2222-4d5b-84d8-a968331b8e23 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:09.271669 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cc1110fe-2222-4d5b-84d8-a968331b8e23 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:09.272495 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cc1110fe-2222-4d5b-84d8-a968331b8e23 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:09.272936 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cc1110fe-2222-4d5b-84d8-a968331b8e23 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:09.327498 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-9b15f15d-2a1a-480d-99bc-247d16a18dab tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:09.328432 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-9b15f15d-2a1a-480d-99bc-247d16a18dab tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:09.337135 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9b15f15d-2a1a-480d-99bc-247d16a18dab tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:09.338375 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9b15f15d-2a1a-480d-99bc-247d16a18dab tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:09.339224 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9b15f15d-2a1a-480d-99bc-247d16a18dab tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:09.339686 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9b15f15d-2a1a-480d-99bc-247d16a18dab tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:09.480264 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-9b15f15d-2a1a-480d-99bc-247d16a18dab tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:09.489254 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-9b15f15d-2a1a-480d-99bc-247d16a18dab tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:09.491179 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-9b15f15d-2a1a-480d-99bc-247d16a18dab tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:09.492538 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-9b15f15d-2a1a-480d-99bc-247d16a18dab tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1334 microversion: 2.20 time: 0.169570 May 23 16:46:09.494034 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 42/86] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:09 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1334 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:46:09.506775 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-cc1110fe-2222-4d5b-84d8-a968331b8e23 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:09.512757 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-b9e01710-556b-4371-8048-16c6bae04604 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:09.513480 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-b9e01710-556b-4371-8048-16c6bae04604 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:09.515151 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-cc1110fe-2222-4d5b-84d8-a968331b8e23 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1322 microversion: 2.1 time: 0.264131 May 23 16:46:09.520340 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 45/87] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:09 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:09.520491 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b9e01710-556b-4371-8048-16c6bae04604 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:09.520743 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b9e01710-556b-4371-8048-16c6bae04604 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:09.520870 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-50792ec7-4523-4747-9fda-d0a7685c327e tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:09.521473 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-50792ec7-4523-4747-9fda-d0a7685c327e tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:09.521636 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b9e01710-556b-4371-8048-16c6bae04604 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:09.522083 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b9e01710-556b-4371-8048-16c6bae04604 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:09.530270 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-50792ec7-4523-4747-9fda-d0a7685c327e tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:09.530849 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-50792ec7-4523-4747-9fda-d0a7685c327e tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:09.535515 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-50792ec7-4523-4747-9fda-d0a7685c327e tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:09.535515 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-50792ec7-4523-4747-9fda-d0a7685c327e tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:09.620590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b9e01710-556b-4371-8048-16c6bae04604 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:09.628677 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-b9e01710-556b-4371-8048-16c6bae04604 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1289 microversion: 2.1 time: 0.121823 May 23 16:46:09.629254 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 43/88] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:09 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1289 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:09.635017 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-6d979274-e3aa-4391-af83-6f9b61428cd6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:09.635810 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-6d979274-e3aa-4391-af83-6f9b61428cd6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:09.641984 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6d979274-e3aa-4391-af83-6f9b61428cd6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:09.642495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6d979274-e3aa-4391-af83-6f9b61428cd6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:09.643223 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6d979274-e3aa-4391-af83-6f9b61428cd6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:09.643668 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6d979274-e3aa-4391-af83-6f9b61428cd6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:09.697491 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-50792ec7-4523-4747-9fda-d0a7685c327e tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:09.700129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=100 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:09.706757 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-50792ec7-4523-4747-9fda-d0a7685c327e tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1314 microversion: 2.1 time: 0.189406 May 23 16:46:09.707578 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 46/89] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:09 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:09.799374 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-6d979274-e3aa-4391-af83-6f9b61428cd6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:09.807890 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-6d979274-e3aa-4391-af83-6f9b61428cd6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1368 microversion: 2.1 time: 0.177318 May 23 16:46:09.809979 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 44/90] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:09 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:10.511974 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-bc919814-9888-460e-982b-26f7912fd73c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:10.512656 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-bc919814-9888-460e-982b-26f7912fd73c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:10.518958 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bc919814-9888-460e-982b-26f7912fd73c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:10.519459 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bc919814-9888-460e-982b-26f7912fd73c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:10.520243 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bc919814-9888-460e-982b-26f7912fd73c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:10.521169 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bc919814-9888-460e-982b-26f7912fd73c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:10.541894 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-6f308bdc-fd27-492a-b57f-83acc972871d req-a4b3c31a-3c98-4a4e-b2c4-f94cbc16bd7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c9f1fc3-3479-44e4-bdbc-702eef9f3920", "name": "network-vif-plugged", "status": "completed", "tag": "e29253f1-4195-40c3-8e0d-2f6697fb6de0"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:46:10.552645 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-6f308bdc-fd27-492a-b57f-83acc972871d req-a4b3c31a-3c98-4a4e-b2c4-f94cbc16bd7b service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:10.553265 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-6f308bdc-fd27-492a-b57f-83acc972871d req-a4b3c31a-3c98-4a4e-b2c4-f94cbc16bd7b service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:10.566487 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-6f308bdc-fd27-492a-b57f-83acc972871d req-a4b3c31a-3c98-4a4e-b2c4-f94cbc16bd7b service nova] Creating event network-vif-plugged:e29253f1-4195-40c3-8e0d-2f6697fb6de0 for instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 on hv-cinder-83925 May 23 16:46:10.572444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-6f308bdc-fd27-492a-b57f-83acc972871d req-a4b3c31a-3c98-4a4e-b2c4-f94cbc16bd7b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158974 May 23 16:46:10.576784 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 47/91] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:46:10.583277 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a76f08ac-f377-42a1-9462-348f267479f6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:10.584176 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a76f08ac-f377-42a1-9462-348f267479f6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:10.601917 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a76f08ac-f377-42a1-9462-348f267479f6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:10.603284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a76f08ac-f377-42a1-9462-348f267479f6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:10.604406 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a76f08ac-f377-42a1-9462-348f267479f6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:10.605008 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a76f08ac-f377-42a1-9462-348f267479f6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:10.614165 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-bc919814-9888-460e-982b-26f7912fd73c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:10.623569 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-bc919814-9888-460e-982b-26f7912fd73c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:10.625136 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-bc919814-9888-460e-982b-26f7912fd73c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:10.626265 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-bc919814-9888-460e-982b-26f7912fd73c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1334 microversion: 2.20 time: 0.118753 May 23 16:46:10.626830 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 45/92] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:10 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1334 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:46:10.656862 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-b94912d4-35ed-481e-b31f-f1333cb8a6f4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:10.657881 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-b94912d4-35ed-481e-b31f-f1333cb8a6f4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:10.667092 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b94912d4-35ed-481e-b31f-f1333cb8a6f4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:10.667865 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b94912d4-35ed-481e-b31f-f1333cb8a6f4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:10.669360 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b94912d4-35ed-481e-b31f-f1333cb8a6f4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:10.675245 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b94912d4-35ed-481e-b31f-f1333cb8a6f4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:10.761196 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b94912d4-35ed-481e-b31f-f1333cb8a6f4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:10.768565 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-b94912d4-35ed-481e-b31f-f1333cb8a6f4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1289 microversion: 2.1 time: 0.126290 May 23 16:46:10.769134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 46/93] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:10 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1289 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:10.773585 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-55fb8300-2794-441b-9f43-e47376d53b5e tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:10.779278 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-55fb8300-2794-441b-9f43-e47376d53b5e tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:10.788195 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-55fb8300-2794-441b-9f43-e47376d53b5e tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:10.788195 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-55fb8300-2794-441b-9f43-e47376d53b5e tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:10.788195 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-55fb8300-2794-441b-9f43-e47376d53b5e tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:10.790866 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-55fb8300-2794-441b-9f43-e47376d53b5e tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:10.803595 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a76f08ac-f377-42a1-9462-348f267479f6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:10.811942 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a76f08ac-f377-42a1-9462-348f267479f6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1322 microversion: 2.1 time: 0.233773 May 23 16:46:10.813241 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 48/94] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:10 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:10.856444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-05bd0fd1-4a0f-48d1-b04b-49bd62df613a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:10.857510 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-05bd0fd1-4a0f-48d1-b04b-49bd62df613a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:10.870709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-05bd0fd1-4a0f-48d1-b04b-49bd62df613a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:10.871160 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-05bd0fd1-4a0f-48d1-b04b-49bd62df613a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:10.871933 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-05bd0fd1-4a0f-48d1-b04b-49bd62df613a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:10.872413 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-05bd0fd1-4a0f-48d1-b04b-49bd62df613a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:10.983716 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-55fb8300-2794-441b-9f43-e47376d53b5e tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:10.991626 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-55fb8300-2794-441b-9f43-e47376d53b5e tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1314 microversion: 2.1 time: 0.221507 May 23 16:46:10.992287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 47/95] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:10 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:11.031041 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-05bd0fd1-4a0f-48d1-b04b-49bd62df613a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:11.038396 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-05bd0fd1-4a0f-48d1-b04b-49bd62df613a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1368 microversion: 2.1 time: 0.216953 May 23 16:46:11.038958 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 49/96] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:10 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:11.646448 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-92d5e0ef-40b4-4f4c-8d20-b73f70bd1fbc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:11.647470 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-92d5e0ef-40b4-4f4c-8d20-b73f70bd1fbc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:11.653418 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-92d5e0ef-40b4-4f4c-8d20-b73f70bd1fbc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:11.653878 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-92d5e0ef-40b4-4f4c-8d20-b73f70bd1fbc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:11.654687 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-92d5e0ef-40b4-4f4c-8d20-b73f70bd1fbc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:11.655157 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-92d5e0ef-40b4-4f4c-8d20-b73f70bd1fbc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:11.718782 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-92d5e0ef-40b4-4f4c-8d20-b73f70bd1fbc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:11.726660 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-92d5e0ef-40b4-4f4c-8d20-b73f70bd1fbc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:11.728824 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-92d5e0ef-40b4-4f4c-8d20-b73f70bd1fbc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:11.729923 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-92d5e0ef-40b4-4f4c-8d20-b73f70bd1fbc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1334 microversion: 2.20 time: 0.089089 May 23 16:46:11.730829 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 48/97] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:11 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1334 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:46:11.785979 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-59ccf5dd-fa99-459f-99e0-601983cffeb2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:11.786600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-59ccf5dd-fa99-459f-99e0-601983cffeb2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:11.793528 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-59ccf5dd-fa99-459f-99e0-601983cffeb2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:11.793987 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-59ccf5dd-fa99-459f-99e0-601983cffeb2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:11.799221 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-59ccf5dd-fa99-459f-99e0-601983cffeb2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:11.799221 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-59ccf5dd-fa99-459f-99e0-601983cffeb2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:11.831768 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-330216db-d3c1-4d44-a1c0-982a5871c899 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:11.833241 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-330216db-d3c1-4d44-a1c0-982a5871c899 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:11.859966 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-330216db-d3c1-4d44-a1c0-982a5871c899 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:11.860957 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-59ccf5dd-fa99-459f-99e0-601983cffeb2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:11.862015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-330216db-d3c1-4d44-a1c0-982a5871c899 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:11.864495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-330216db-d3c1-4d44-a1c0-982a5871c899 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:11.865506 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-330216db-d3c1-4d44-a1c0-982a5871c899 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:11.870667 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-59ccf5dd-fa99-459f-99e0-601983cffeb2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1289 microversion: 2.1 time: 0.087699 May 23 16:46:11.872208 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 50/98] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:11 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:12.010888 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-274f25c5-d7b3-46fe-872a-ea32fa840da7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:12.011918 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-274f25c5-d7b3-46fe-872a-ea32fa840da7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:12.022111 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-274f25c5-d7b3-46fe-872a-ea32fa840da7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:12.023234 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-274f25c5-d7b3-46fe-872a-ea32fa840da7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:12.024279 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-274f25c5-d7b3-46fe-872a-ea32fa840da7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:12.024981 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-274f25c5-d7b3-46fe-872a-ea32fa840da7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:12.083651 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-330216db-d3c1-4d44-a1c0-982a5871c899 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:12.094179 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-330216db-d3c1-4d44-a1c0-982a5871c899 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1322 microversion: 2.1 time: 0.267740 May 23 16:46:12.096941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 49/99] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:11 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:12.105563 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-999dd2a4-6955-467a-9a36-6a06175a443d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:12.106177 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-999dd2a4-6955-467a-9a36-6a06175a443d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:12.119305 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-999dd2a4-6955-467a-9a36-6a06175a443d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:12.119976 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-999dd2a4-6955-467a-9a36-6a06175a443d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:12.121015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-999dd2a4-6955-467a-9a36-6a06175a443d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:12.121452 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-999dd2a4-6955-467a-9a36-6a06175a443d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:12.262298 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-274f25c5-d7b3-46fe-872a-ea32fa840da7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:12.268563 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-274f25c5-d7b3-46fe-872a-ea32fa840da7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1314 microversion: 2.1 time: 0.263360 May 23 16:46:12.279404 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 51/100] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:12 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:12.316925 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-999dd2a4-6955-467a-9a36-6a06175a443d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:12.325246 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-999dd2a4-6955-467a-9a36-6a06175a443d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1368 microversion: 2.1 time: 0.227200 May 23 16:46:12.325931 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 50/101] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:12 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1368 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:12.749022 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-367e8b80-3332-424e-b3e4-8dfa4f167d6a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:12.749882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-367e8b80-3332-424e-b3e4-8dfa4f167d6a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:12.756088 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-367e8b80-3332-424e-b3e4-8dfa4f167d6a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:12.756637 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-367e8b80-3332-424e-b3e4-8dfa4f167d6a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:12.757482 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-367e8b80-3332-424e-b3e4-8dfa4f167d6a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:12.757943 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-367e8b80-3332-424e-b3e4-8dfa4f167d6a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:12.819487 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=6 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:12.825589 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-367e8b80-3332-424e-b3e4-8dfa4f167d6a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:12.833826 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-367e8b80-3332-424e-b3e4-8dfa4f167d6a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:12.835326 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-367e8b80-3332-424e-b3e4-8dfa4f167d6a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:12.836492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-367e8b80-3332-424e-b3e4-8dfa4f167d6a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1334 microversion: 2.20 time: 0.091358 May 23 16:46:12.837052 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 52/102] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:12 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1334 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:46:12.887133 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-858679ef-16a6-405c-b062-c739dbf90223 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:12.887785 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-858679ef-16a6-405c-b062-c739dbf90223 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:12.894260 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-858679ef-16a6-405c-b062-c739dbf90223 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:12.894749 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-858679ef-16a6-405c-b062-c739dbf90223 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:12.895518 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-858679ef-16a6-405c-b062-c739dbf90223 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:12.895999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-858679ef-16a6-405c-b062-c739dbf90223 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:12.959876 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-858679ef-16a6-405c-b062-c739dbf90223 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:12.968239 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-858679ef-16a6-405c-b062-c739dbf90223 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1289 microversion: 2.1 time: 0.085031 May 23 16:46:12.968846 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 51/103] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:12 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1289 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:13.113646 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-5c2c2ba0-0b71-4079-b675-c6356156a174 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:13.114347 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-5c2c2ba0-0b71-4079-b675-c6356156a174 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:13.120575 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5c2c2ba0-0b71-4079-b675-c6356156a174 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:13.121236 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5c2c2ba0-0b71-4079-b675-c6356156a174 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:13.122008 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5c2c2ba0-0b71-4079-b675-c6356156a174 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:13.122445 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5c2c2ba0-0b71-4079-b675-c6356156a174 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:13.253617 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-5c2c2ba0-0b71-4079-b675-c6356156a174 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:13.261933 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-5c2c2ba0-0b71-4079-b675-c6356156a174 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1322 microversion: 2.1 time: 0.152035 May 23 16:46:13.262503 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 53/104] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:13 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:13.286383 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-0d7a94f4-cd7b-406c-9182-df29ee2c8636 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:13.287415 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-0d7a94f4-cd7b-406c-9182-df29ee2c8636 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:13.296187 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0d7a94f4-cd7b-406c-9182-df29ee2c8636 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:13.296187 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0d7a94f4-cd7b-406c-9182-df29ee2c8636 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:13.296187 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0d7a94f4-cd7b-406c-9182-df29ee2c8636 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:13.297024 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0d7a94f4-cd7b-406c-9182-df29ee2c8636 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:13.345223 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-feb1cbd9-f125-4fa9-a14e-f1fb9373e2b4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:13.345961 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-feb1cbd9-f125-4fa9-a14e-f1fb9373e2b4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:13.354680 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-feb1cbd9-f125-4fa9-a14e-f1fb9373e2b4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:13.354680 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-feb1cbd9-f125-4fa9-a14e-f1fb9373e2b4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:13.354680 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-feb1cbd9-f125-4fa9-a14e-f1fb9373e2b4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:13.357767 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-feb1cbd9-f125-4fa9-a14e-f1fb9373e2b4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:13.425733 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=22 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:13.500574 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-0d7a94f4-cd7b-406c-9182-df29ee2c8636 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:13.510190 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-0d7a94f4-cd7b-406c-9182-df29ee2c8636 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1314 microversion: 2.1 time: 0.228223 May 23 16:46:13.511093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 52/105] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:13 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:13.527643 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-feb1cbd9-f125-4fa9-a14e-f1fb9373e2b4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:13.535779 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-feb1cbd9-f125-4fa9-a14e-f1fb9373e2b4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1368 microversion: 2.1 time: 0.196441 May 23 16:46:13.536364 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 54/106] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:13 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:13.855250 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-677aae2b-d277-4cae-a343-950b1a056523 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:13.855999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-677aae2b-d277-4cae-a343-950b1a056523 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:13.857861 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=8 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:13.862725 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-677aae2b-d277-4cae-a343-950b1a056523 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:13.863172 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-677aae2b-d277-4cae-a343-950b1a056523 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:13.863930 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-677aae2b-d277-4cae-a343-950b1a056523 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:13.864419 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-677aae2b-d277-4cae-a343-950b1a056523 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:13.925437 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-677aae2b-d277-4cae-a343-950b1a056523 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:13.934690 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-677aae2b-d277-4cae-a343-950b1a056523 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:13.936197 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-677aae2b-d277-4cae-a343-950b1a056523 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:13.937331 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-677aae2b-d277-4cae-a343-950b1a056523 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1342 microversion: 2.20 time: 0.086706 May 23 16:46:13.937875 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 53/107] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:13 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1342 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:46:13.986876 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e24c0388-0eb7-4534-afd2-145ae56a3e08 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:13.992646 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e24c0388-0eb7-4534-afd2-145ae56a3e08 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:13.993736 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e24c0388-0eb7-4534-afd2-145ae56a3e08 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:13.994189 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e24c0388-0eb7-4534-afd2-145ae56a3e08 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:13.994965 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e24c0388-0eb7-4534-afd2-145ae56a3e08 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:13.995402 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e24c0388-0eb7-4534-afd2-145ae56a3e08 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:14.057336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e24c0388-0eb7-4534-afd2-145ae56a3e08 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:14.064903 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e24c0388-0eb7-4534-afd2-145ae56a3e08 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1289 microversion: 2.1 time: 0.082867 May 23 16:46:14.065527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 55/108] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:13 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1289 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:14.280207 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-af0dee2d-3f0d-45a9-be91-5f3a093398d4 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:14.280973 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-af0dee2d-3f0d-45a9-be91-5f3a093398d4 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:14.287658 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-af0dee2d-3f0d-45a9-be91-5f3a093398d4 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:14.288357 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-af0dee2d-3f0d-45a9-be91-5f3a093398d4 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:14.289234 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-af0dee2d-3f0d-45a9-be91-5f3a093398d4 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:14.290746 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-af0dee2d-3f0d-45a9-be91-5f3a093398d4 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:14.437237 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-af0dee2d-3f0d-45a9-be91-5f3a093398d4 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:14.444691 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-af0dee2d-3f0d-45a9-be91-5f3a093398d4 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1322 microversion: 2.1 time: 0.168851 May 23 16:46:14.445199 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 54/109] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:14 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:14.527006 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-89188497-d2fc-41d9-831e-14b7b38cf31c tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:14.527617 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-89188497-d2fc-41d9-831e-14b7b38cf31c tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:14.534178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-89188497-d2fc-41d9-831e-14b7b38cf31c tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:14.534622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-89188497-d2fc-41d9-831e-14b7b38cf31c tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:14.535376 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-89188497-d2fc-41d9-831e-14b7b38cf31c tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:14.535803 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-89188497-d2fc-41d9-831e-14b7b38cf31c tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:14.553815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-4b1d9671-4726-4ec0-a784-941a094005b1 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:14.554588 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-4b1d9671-4726-4ec0-a784-941a094005b1 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:14.561589 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4b1d9671-4726-4ec0-a784-941a094005b1 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:14.562080 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4b1d9671-4726-4ec0-a784-941a094005b1 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:14.562852 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4b1d9671-4726-4ec0-a784-941a094005b1 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:14.563297 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4b1d9671-4726-4ec0-a784-941a094005b1 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:14.738166 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-89188497-d2fc-41d9-831e-14b7b38cf31c tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:14.758759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-89188497-d2fc-41d9-831e-14b7b38cf31c tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1314 microversion: 2.1 time: 0.235349 May 23 16:46:14.759452 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 56/110] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:14 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:14.768954 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-4b1d9671-4726-4ec0-a784-941a094005b1 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:14.778117 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-4b1d9671-4726-4ec0-a784-941a094005b1 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1368 microversion: 2.1 time: 0.228037 May 23 16:46:14.778929 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 55/111] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:14 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:14.957139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-8cead0da-4e2d-4220-a0e1-dd44846f3317 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:14.958004 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-8cead0da-4e2d-4220-a0e1-dd44846f3317 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:14.964824 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8cead0da-4e2d-4220-a0e1-dd44846f3317 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:14.965526 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8cead0da-4e2d-4220-a0e1-dd44846f3317 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:14.966302 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8cead0da-4e2d-4220-a0e1-dd44846f3317 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:14.966889 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8cead0da-4e2d-4220-a0e1-dd44846f3317 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:15.035631 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-8cead0da-4e2d-4220-a0e1-dd44846f3317 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:15.044635 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-8cead0da-4e2d-4220-a0e1-dd44846f3317 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:15.046199 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-8cead0da-4e2d-4220-a0e1-dd44846f3317 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:15.047307 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-8cead0da-4e2d-4220-a0e1-dd44846f3317 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1342 microversion: 2.20 time: 0.096282 May 23 16:46:15.047880 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 57/112] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:14 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1342 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:46:15.082995 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-9cb1a984-d722-4b8e-a931-67cac2f591a9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:15.083607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-9cb1a984-d722-4b8e-a931-67cac2f591a9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:15.089619 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9cb1a984-d722-4b8e-a931-67cac2f591a9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:15.090068 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9cb1a984-d722-4b8e-a931-67cac2f591a9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:15.101302 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9cb1a984-d722-4b8e-a931-67cac2f591a9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:15.101302 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9cb1a984-d722-4b8e-a931-67cac2f591a9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:15.119127 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=100 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:15.231943 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-9cb1a984-d722-4b8e-a931-67cac2f591a9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:15.240060 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-d2400e4b-7ec8-432d-aba3-75a49ccf55f4 req-521255b8-f961-4198-a7ec-307f9d38cd31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ff57504-04ce-414c-b676-fb6bcec4cccf", "name": "network-vif-plugged", "status": "completed", "tag": "a89d6674-fb70-4453-b26a-4eb162b70152"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:46:15.252689 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-d2400e4b-7ec8-432d-aba3-75a49ccf55f4 req-521255b8-f961-4198-a7ec-307f9d38cd31 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:15.254388 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-9cb1a984-d722-4b8e-a931-67cac2f591a9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1289 microversion: 2.1 time: 0.174570 May 23 16:46:15.255611 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 56/113] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:15 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1289 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:15.258330 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-d2400e4b-7ec8-432d-aba3-75a49ccf55f4 req-521255b8-f961-4198-a7ec-307f9d38cd31 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:15.282653 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-d2400e4b-7ec8-432d-aba3-75a49ccf55f4 req-521255b8-f961-4198-a7ec-307f9d38cd31 service nova] Creating event network-vif-plugged:a89d6674-fb70-4453-b26a-4eb162b70152 for instance 2ff57504-04ce-414c-b676-fb6bcec4cccf on hv-cinder-83925 May 23 16:46:15.288242 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-d2400e4b-7ec8-432d-aba3-75a49ccf55f4 req-521255b8-f961-4198-a7ec-307f9d38cd31 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054873 May 23 16:46:15.289038 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 58/114] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:46:15.465360 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-05b18da2-d32e-44aa-879a-004bf860b8cd tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:15.466154 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-05b18da2-d32e-44aa-879a-004bf860b8cd tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:15.472828 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-05b18da2-d32e-44aa-879a-004bf860b8cd tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:15.473354 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-05b18da2-d32e-44aa-879a-004bf860b8cd tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:15.474217 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-05b18da2-d32e-44aa-879a-004bf860b8cd tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:15.474866 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-05b18da2-d32e-44aa-879a-004bf860b8cd tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:15.782815 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-90961066-f130-41d9-a28d-e057c3e423b7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:15.784368 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-90961066-f130-41d9-a28d-e057c3e423b7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:15.797938 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-90961066-f130-41d9-a28d-e057c3e423b7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:15.799787 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-90961066-f130-41d9-a28d-e057c3e423b7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:15.801449 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-90961066-f130-41d9-a28d-e057c3e423b7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:15.803153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-90961066-f130-41d9-a28d-e057c3e423b7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:15.905443 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-05b18da2-d32e-44aa-879a-004bf860b8cd tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:15.915050 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-05b18da2-d32e-44aa-879a-004bf860b8cd tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1322 microversion: 2.1 time: 0.453697 May 23 16:46:15.916692 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 57/115] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:15 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1322 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:15.922340 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-fd6978a1-27fd-4609-908d-4b548ecf4889 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:15.923247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-fd6978a1-27fd-4609-908d-4b548ecf4889 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:15.935222 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fd6978a1-27fd-4609-908d-4b548ecf4889 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:15.935798 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fd6978a1-27fd-4609-908d-4b548ecf4889 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:15.937091 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fd6978a1-27fd-4609-908d-4b548ecf4889 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:15.937506 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fd6978a1-27fd-4609-908d-4b548ecf4889 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:16.135408 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-90961066-f130-41d9-a28d-e057c3e423b7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:16.146307 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-90961066-f130-41d9-a28d-e057c3e423b7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1314 microversion: 2.1 time: 0.374940 May 23 16:46:16.147239 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 59/116] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:15 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:16.152230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c18e9d65-ff05-4cfe-8de2-5d6856282693 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:16.152969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-c18e9d65-ff05-4cfe-8de2-5d6856282693 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:16.159584 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c18e9d65-ff05-4cfe-8de2-5d6856282693 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:16.160253 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c18e9d65-ff05-4cfe-8de2-5d6856282693 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:16.161215 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c18e9d65-ff05-4cfe-8de2-5d6856282693 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:16.161657 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c18e9d65-ff05-4cfe-8de2-5d6856282693 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:16.167411 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-fd6978a1-27fd-4609-908d-4b548ecf4889 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:16.175583 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-fd6978a1-27fd-4609-908d-4b548ecf4889 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1368 microversion: 2.1 time: 0.257700 May 23 16:46:16.176164 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 58/117] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:15 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1368 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:16.226585 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-c18e9d65-ff05-4cfe-8de2-5d6856282693 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:16.235131 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-c18e9d65-ff05-4cfe-8de2-5d6856282693 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:16.236681 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-c18e9d65-ff05-4cfe-8de2-5d6856282693 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:16.237786 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-c18e9d65-ff05-4cfe-8de2-5d6856282693 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1340 microversion: 2.20 time: 0.089297 May 23 16:46:16.238344 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 60/118] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:16 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1340 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:46:16.271176 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-84c3294e-d806-414c-83ac-1c774ace5d7a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:16.271822 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-84c3294e-d806-414c-83ac-1c774ace5d7a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:16.278904 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-84c3294e-d806-414c-83ac-1c774ace5d7a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:16.279381 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-84c3294e-d806-414c-83ac-1c774ace5d7a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:16.280168 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-84c3294e-d806-414c-83ac-1c774ace5d7a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:16.280635 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-84c3294e-d806-414c-83ac-1c774ace5d7a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:16.350215 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-84c3294e-d806-414c-83ac-1c774ace5d7a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:16.359857 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-84c3294e-d806-414c-83ac-1c774ace5d7a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1307 microversion: 2.1 time: 0.092644 May 23 16:46:16.360511 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 59/119] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:16 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:16.936063 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e57f1e84-a300-4c3f-bd03-d3504d2c4906 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:16.936063 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e57f1e84-a300-4c3f-bd03-d3504d2c4906 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:16.944269 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e57f1e84-a300-4c3f-bd03-d3504d2c4906 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:16.944948 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e57f1e84-a300-4c3f-bd03-d3504d2c4906 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:16.945836 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e57f1e84-a300-4c3f-bd03-d3504d2c4906 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:16.946282 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e57f1e84-a300-4c3f-bd03-d3504d2c4906 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:17.079630 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e57f1e84-a300-4c3f-bd03-d3504d2c4906 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:17.088189 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e57f1e84-a300-4c3f-bd03-d3504d2c4906 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1322 microversion: 2.1 time: 0.159904 May 23 16:46:17.089114 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 61/120] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:16 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:17.164805 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-033474c1-dd79-49e1-8806-acd3dba8dc9d tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:17.165481 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-033474c1-dd79-49e1-8806-acd3dba8dc9d tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:17.167487 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:17.172633 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-033474c1-dd79-49e1-8806-acd3dba8dc9d tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:17.173168 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-033474c1-dd79-49e1-8806-acd3dba8dc9d tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:17.173984 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-033474c1-dd79-49e1-8806-acd3dba8dc9d tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:17.174430 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-033474c1-dd79-49e1-8806-acd3dba8dc9d tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:17.194542 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-b767e752-962b-4f38-b991-ac188338ce3b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:17.196138 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-b767e752-962b-4f38-b991-ac188338ce3b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:17.204005 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b767e752-962b-4f38-b991-ac188338ce3b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:17.204509 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b767e752-962b-4f38-b991-ac188338ce3b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:17.205390 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b767e752-962b-4f38-b991-ac188338ce3b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:17.205838 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b767e752-962b-4f38-b991-ac188338ce3b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:17.372656 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-033474c1-dd79-49e1-8806-acd3dba8dc9d tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:17.380493 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-033474c1-dd79-49e1-8806-acd3dba8dc9d tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1314 microversion: 2.1 time: 0.220833 May 23 16:46:17.381466 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 60/121] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:17 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:17.383822 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-b767e752-962b-4f38-b991-ac188338ce3b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:17.387352 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-0d27ecb5-ba13-420e-8b09-eea7364c312b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:17.387967 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-0d27ecb5-ba13-420e-8b09-eea7364c312b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:17.394591 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-b767e752-962b-4f38-b991-ac188338ce3b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1368 microversion: 2.1 time: 0.204865 May 23 16:46:17.395183 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0d27ecb5-ba13-420e-8b09-eea7364c312b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:17.395312 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 62/122] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:17 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:17.396126 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0d27ecb5-ba13-420e-8b09-eea7364c312b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:17.397365 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0d27ecb5-ba13-420e-8b09-eea7364c312b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:17.397792 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0d27ecb5-ba13-420e-8b09-eea7364c312b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:17.402014 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-10169d9d-a9b5-4e7a-b2d6-a4d5bca260e2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:17.402637 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-10169d9d-a9b5-4e7a-b2d6-a4d5bca260e2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:17.409776 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-10169d9d-a9b5-4e7a-b2d6-a4d5bca260e2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:17.410262 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-10169d9d-a9b5-4e7a-b2d6-a4d5bca260e2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:17.411046 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-10169d9d-a9b5-4e7a-b2d6-a4d5bca260e2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:17.411491 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-10169d9d-a9b5-4e7a-b2d6-a4d5bca260e2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:17.495061 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-10169d9d-a9b5-4e7a-b2d6-a4d5bca260e2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:17.504874 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-10169d9d-a9b5-4e7a-b2d6-a4d5bca260e2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1295 microversion: 2.1 time: 0.106152 May 23 16:46:17.537015 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 63/123] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:17 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1295 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:17.564193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-0d27ecb5-ba13-420e-8b09-eea7364c312b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:17.572169 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-0d27ecb5-ba13-420e-8b09-eea7364c312b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:17.573856 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-0d27ecb5-ba13-420e-8b09-eea7364c312b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:17.574912 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-0d27ecb5-ba13-420e-8b09-eea7364c312b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1407 microversion: 2.20 time: 0.192171 May 23 16:46:17.575475 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 61/124] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:17 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:46:18.110722 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-cc0ae879-5ef1-4f4b-bed0-e3de0279ff79 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:18.110722 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-cc0ae879-5ef1-4f4b-bed0-e3de0279ff79 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:18.110962 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cc0ae879-5ef1-4f4b-bed0-e3de0279ff79 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:18.111364 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cc0ae879-5ef1-4f4b-bed0-e3de0279ff79 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:18.112129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cc0ae879-5ef1-4f4b-bed0-e3de0279ff79 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:18.112625 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cc0ae879-5ef1-4f4b-bed0-e3de0279ff79 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:18.249347 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-cc0ae879-5ef1-4f4b-bed0-e3de0279ff79 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:18.251640 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=100 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:18.257483 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-cc0ae879-5ef1-4f4b-bed0-e3de0279ff79 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1322 microversion: 2.1 time: 0.157260 May 23 16:46:18.258047 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 64/125] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:18 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:18.397790 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-858cdab3-19fa-447a-b695-dabd4422b28a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:18.398329 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-858cdab3-19fa-447a-b695-dabd4422b28a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:18.405670 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-858cdab3-19fa-447a-b695-dabd4422b28a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:18.406128 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-858cdab3-19fa-447a-b695-dabd4422b28a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:18.406903 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-858cdab3-19fa-447a-b695-dabd4422b28a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:18.407349 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-858cdab3-19fa-447a-b695-dabd4422b28a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:18.412739 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-f07c5ec4-73d1-4fab-ba81-50fc0fed49c6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:18.413468 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-f07c5ec4-73d1-4fab-ba81-50fc0fed49c6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:18.421085 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f07c5ec4-73d1-4fab-ba81-50fc0fed49c6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:18.421560 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f07c5ec4-73d1-4fab-ba81-50fc0fed49c6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:18.422386 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f07c5ec4-73d1-4fab-ba81-50fc0fed49c6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:18.422829 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f07c5ec4-73d1-4fab-ba81-50fc0fed49c6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:18.603751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-858cdab3-19fa-447a-b695-dabd4422b28a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:18.610544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f07c5ec4-73d1-4fab-ba81-50fc0fed49c6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:18.612578 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-858cdab3-19fa-447a-b695-dabd4422b28a tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1314 microversion: 2.1 time: 0.218395 May 23 16:46:18.613384 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 62/126] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:18 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:18.618312 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-f07c5ec4-73d1-4fab-ba81-50fc0fed49c6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1368 microversion: 2.1 time: 0.209892 May 23 16:46:18.619083 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 65/127] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:18 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:18.619294 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ee83cd33-6cc4-4eb3-884e-4564ac3d5147 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:18.620153 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ee83cd33-6cc4-4eb3-884e-4564ac3d5147 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:18.626554 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ee83cd33-6cc4-4eb3-884e-4564ac3d5147 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:18.627080 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ee83cd33-6cc4-4eb3-884e-4564ac3d5147 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:18.627915 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ee83cd33-6cc4-4eb3-884e-4564ac3d5147 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:18.628388 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ee83cd33-6cc4-4eb3-884e-4564ac3d5147 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:18.630636 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-f8b1b035-c047-4fdd-80c3-2ab582b786a2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:18.631250 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-f8b1b035-c047-4fdd-80c3-2ab582b786a2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:18.638658 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f8b1b035-c047-4fdd-80c3-2ab582b786a2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:18.639147 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f8b1b035-c047-4fdd-80c3-2ab582b786a2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:18.640010 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f8b1b035-c047-4fdd-80c3-2ab582b786a2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:18.640484 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f8b1b035-c047-4fdd-80c3-2ab582b786a2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:18.693175 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ee83cd33-6cc4-4eb3-884e-4564ac3d5147 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:18.701514 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ee83cd33-6cc4-4eb3-884e-4564ac3d5147 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1295 microversion: 2.1 time: 0.086664 May 23 16:46:18.702095 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 63/128] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:18 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1295 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:18.800975 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f8b1b035-c047-4fdd-80c3-2ab582b786a2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:18.810218 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f8b1b035-c047-4fdd-80c3-2ab582b786a2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:18.811729 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f8b1b035-c047-4fdd-80c3-2ab582b786a2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:18.812941 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-f8b1b035-c047-4fdd-80c3-2ab582b786a2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1407 microversion: 2.20 time: 0.186424 May 23 16:46:18.813508 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 66/129] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:18 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:46:19.247580 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-26bae08f-00e0-45df-b96a-4dbb6af546d2 req-200c0da8-d707-4a2a-97c2-4205f9db85d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5e6ec2-b063-4631-9582-9d94a739d3b7", "name": "network-vif-plugged", "status": "completed", "tag": "e6e977d2-2ea9-45e2-bc52-5193a7346b82"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:46:19.255574 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-26bae08f-00e0-45df-b96a-4dbb6af546d2 req-200c0da8-d707-4a2a-97c2-4205f9db85d0 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:19.256013 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-26bae08f-00e0-45df-b96a-4dbb6af546d2 req-200c0da8-d707-4a2a-97c2-4205f9db85d0 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:19.266726 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-26bae08f-00e0-45df-b96a-4dbb6af546d2 req-200c0da8-d707-4a2a-97c2-4205f9db85d0 service nova] Creating event network-vif-plugged:e6e977d2-2ea9-45e2-bc52-5193a7346b82 for instance ff5e6ec2-b063-4631-9582-9d94a739d3b7 on hv-cinder-83925 May 23 16:46:19.271636 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-26bae08f-00e0-45df-b96a-4dbb6af546d2 req-200c0da8-d707-4a2a-97c2-4205f9db85d0 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028541 May 23 16:46:19.272219 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 64/130] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:46:19.276777 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-80b26be5-7bf4-440d-b4eb-7d1780eb5ce7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:19.276777 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-80b26be5-7bf4-440d-b4eb-7d1780eb5ce7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:19.277623 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:19.282258 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-80b26be5-7bf4-440d-b4eb-7d1780eb5ce7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:19.282695 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-80b26be5-7bf4-440d-b4eb-7d1780eb5ce7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:19.283470 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-80b26be5-7bf4-440d-b4eb-7d1780eb5ce7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:19.283909 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-80b26be5-7bf4-440d-b4eb-7d1780eb5ce7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:19.417568 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-80b26be5-7bf4-440d-b4eb-7d1780eb5ce7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:19.432912 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-80b26be5-7bf4-440d-b4eb-7d1780eb5ce7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1322 microversion: 2.1 time: 0.154340 May 23 16:46:19.432912 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 67/131] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:19 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:19.629376 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-61861ddf-f0cd-4e64-b565-96c0073503d7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:19.630133 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-61861ddf-f0cd-4e64-b565-96c0073503d7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:19.634996 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7c00c37d-5825-4ead-8663-a576d9b05ec8 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:19.635666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-7c00c37d-5825-4ead-8663-a576d9b05ec8 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:19.636602 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-61861ddf-f0cd-4e64-b565-96c0073503d7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:19.637054 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-61861ddf-f0cd-4e64-b565-96c0073503d7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:19.637834 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-61861ddf-f0cd-4e64-b565-96c0073503d7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:19.638262 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-61861ddf-f0cd-4e64-b565-96c0073503d7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:19.642053 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7c00c37d-5825-4ead-8663-a576d9b05ec8 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:19.642492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7c00c37d-5825-4ead-8663-a576d9b05ec8 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:19.649621 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7c00c37d-5825-4ead-8663-a576d9b05ec8 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:19.649621 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7c00c37d-5825-4ead-8663-a576d9b05ec8 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:19.834609 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-61861ddf-f0cd-4e64-b565-96c0073503d7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:19.838486 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-7c00c37d-5825-4ead-8663-a576d9b05ec8 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:19.842701 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-61861ddf-f0cd-4e64-b565-96c0073503d7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1314 microversion: 2.1 time: 0.217454 May 23 16:46:19.843286 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 65/132] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:19 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:19.847034 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-7c00c37d-5825-4ead-8663-a576d9b05ec8 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1368 microversion: 2.1 time: 0.215828 May 23 16:46:19.848270 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-5f462dd0-58e8-417b-8aed-de0f82efbc31 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:19.849125 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-5f462dd0-58e8-417b-8aed-de0f82efbc31 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:19.855484 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-5f462dd0-58e8-417b-8aed-de0f82efbc31 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:19.855967 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-5f462dd0-58e8-417b-8aed-de0f82efbc31 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:19.856772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-5f462dd0-58e8-417b-8aed-de0f82efbc31 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:19.857217 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-5f462dd0-58e8-417b-8aed-de0f82efbc31 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:19.857452 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 68/133] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:19 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:19.862563 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-50ef2af5-b28c-4c8b-9d1e-ae3b046d1d13 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:19.863167 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-50ef2af5-b28c-4c8b-9d1e-ae3b046d1d13 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:19.869328 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-50ef2af5-b28c-4c8b-9d1e-ae3b046d1d13 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:19.870447 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-50ef2af5-b28c-4c8b-9d1e-ae3b046d1d13 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:19.871266 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-50ef2af5-b28c-4c8b-9d1e-ae3b046d1d13 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:19.871700 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-50ef2af5-b28c-4c8b-9d1e-ae3b046d1d13 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:19.927261 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-5f462dd0-58e8-417b-8aed-de0f82efbc31 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:19.935607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-5f462dd0-58e8-417b-8aed-de0f82efbc31 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1295 microversion: 2.1 time: 0.091169 May 23 16:46:19.937237 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 66/134] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:19 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1295 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:20.030792 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-50ef2af5-b28c-4c8b-9d1e-ae3b046d1d13 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:20.052191 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-50ef2af5-b28c-4c8b-9d1e-ae3b046d1d13 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:20.053741 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-50ef2af5-b28c-4c8b-9d1e-ae3b046d1d13 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:20.054857 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-50ef2af5-b28c-4c8b-9d1e-ae3b046d1d13 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1407 microversion: 2.20 time: 0.196404 May 23 16:46:20.079606 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 69/135] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:19 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:46:20.447366 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-b2c6c69f-b1bd-4c0d-8fce-118b1273a6a5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:20.449195 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-b2c6c69f-b1bd-4c0d-8fce-118b1273a6a5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:20.465093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b2c6c69f-b1bd-4c0d-8fce-118b1273a6a5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:20.465557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b2c6c69f-b1bd-4c0d-8fce-118b1273a6a5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:20.466358 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b2c6c69f-b1bd-4c0d-8fce-118b1273a6a5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:20.467003 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b2c6c69f-b1bd-4c0d-8fce-118b1273a6a5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:20.702220 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b2c6c69f-b1bd-4c0d-8fce-118b1273a6a5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:20.709786 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-b2c6c69f-b1bd-4c0d-8fce-118b1273a6a5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1322 microversion: 2.1 time: 0.266670 May 23 16:46:20.713641 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 67/136] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:20 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:20.865067 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-1db9f020-8518-429c-b3ea-5f45a5585ee5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:20.866203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-1db9f020-8518-429c-b3ea-5f45a5585ee5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:20.867162 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7f12d0a9-1b87-4428-8f1b-3623a4b79c72 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:20.870296 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-7f12d0a9-1b87-4428-8f1b-3623a4b79c72 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:20.874418 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1db9f020-8518-429c-b3ea-5f45a5585ee5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:20.875068 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1db9f020-8518-429c-b3ea-5f45a5585ee5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:20.876290 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1db9f020-8518-429c-b3ea-5f45a5585ee5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:20.877013 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1db9f020-8518-429c-b3ea-5f45a5585ee5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:20.895592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7f12d0a9-1b87-4428-8f1b-3623a4b79c72 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:20.896529 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7f12d0a9-1b87-4428-8f1b-3623a4b79c72 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:20.897976 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7f12d0a9-1b87-4428-8f1b-3623a4b79c72 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:20.898811 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7f12d0a9-1b87-4428-8f1b-3623a4b79c72 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:21.484200 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-1db9f020-8518-429c-b3ea-5f45a5585ee5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:21.505916 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-1db9f020-8518-429c-b3ea-5f45a5585ee5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1368 microversion: 2.1 time: 0.634480 May 23 16:46:21.511127 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-7f12d0a9-1b87-4428-8f1b-3623a4b79c72 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:21.516706 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 68/137] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:20 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1368 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:21.520183 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-7f12d0a9-1b87-4428-8f1b-3623a4b79c72 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1501 microversion: 2.1 time: 0.662969 May 23 16:46:21.520799 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 70/138] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:20 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1501 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:21.539359 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-8c9f6947-f0c0-4ae5-8780-c9b4e044f2c8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:21.540097 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-8c9f6947-f0c0-4ae5-8780-c9b4e044f2c8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:21.542610 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-b7326713-5288-46b6-97da-1117caeb25d3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:21.543234 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-b7326713-5288-46b6-97da-1117caeb25d3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:21.548112 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8c9f6947-f0c0-4ae5-8780-c9b4e044f2c8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:21.548616 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8c9f6947-f0c0-4ae5-8780-c9b4e044f2c8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:21.549451 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8c9f6947-f0c0-4ae5-8780-c9b4e044f2c8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:21.549877 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8c9f6947-f0c0-4ae5-8780-c9b4e044f2c8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:21.564128 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b7326713-5288-46b6-97da-1117caeb25d3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:21.564128 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b7326713-5288-46b6-97da-1117caeb25d3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:21.564128 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b7326713-5288-46b6-97da-1117caeb25d3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:21.564128 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b7326713-5288-46b6-97da-1117caeb25d3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:22.058042 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-b7326713-5288-46b6-97da-1117caeb25d3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:22.063666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8c9f6947-f0c0-4ae5-8780-c9b4e044f2c8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:22.071153 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-8c9f6947-f0c0-4ae5-8780-c9b4e044f2c8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1363 microversion: 2.1 time: 0.553302 May 23 16:46:22.071747 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 69/139] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:21 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1363 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:22.081392 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-2cc0b569-4843-4021-85ff-795af66addc3 req-3420697b-a4a8-495e-b9e1-1c9f2871c83e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb302c29-c30d-4ffa-af9d-1f226fd56357", "tag": "bd409a76-162e-44c7-9e54-76b5e47accda"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:46:22.083094 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-b7326713-5288-46b6-97da-1117caeb25d3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:22.087151 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-b7326713-5288-46b6-97da-1117caeb25d3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:22.088233 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-b7326713-5288-46b6-97da-1117caeb25d3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1407 microversion: 2.20 time: 0.564819 May 23 16:46:22.101773 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 71/140] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:21 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1407 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:46:22.110514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-cf2e73a4-77f6-4723-8343-aed3a6ed9df8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:22.110760 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-2cc0b569-4843-4021-85ff-795af66addc3 req-3420697b-a4a8-495e-b9e1-1c9f2871c83e service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:22.111045 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-2cc0b569-4843-4021-85ff-795af66addc3 req-3420697b-a4a8-495e-b9e1-1c9f2871c83e service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:22.113701 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-cf2e73a4-77f6-4723-8343-aed3a6ed9df8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:22.123234 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-2cc0b569-4843-4021-85ff-795af66addc3 req-3420697b-a4a8-495e-b9e1-1c9f2871c83e service nova] Creating event network-changed:bd409a76-162e-44c7-9e54-76b5e47accda for instance bb302c29-c30d-4ffa-af9d-1f226fd56357 on hv-cinder-83925 May 23 16:46:22.124570 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cf2e73a4-77f6-4723-8343-aed3a6ed9df8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:22.132734 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cf2e73a4-77f6-4723-8343-aed3a6ed9df8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:22.134073 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cf2e73a4-77f6-4723-8343-aed3a6ed9df8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:22.135809 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cf2e73a4-77f6-4723-8343-aed3a6ed9df8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:22.147544 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-2cc0b569-4843-4021-85ff-795af66addc3 req-3420697b-a4a8-495e-b9e1-1c9f2871c83e service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071307 May 23 16:46:22.147544 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 70/141] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:46:22.376272 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-cf2e73a4-77f6-4723-8343-aed3a6ed9df8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:22.384105 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-cf2e73a4-77f6-4723-8343-aed3a6ed9df8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1322 microversion: 2.1 time: 0.278464 May 23 16:46:22.384742 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 72/142] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:22 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:22.526372 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-784e94db-3da1-4986-852a-22c5a5401c29 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:22.527125 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-784e94db-3da1-4986-852a-22c5a5401c29 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:22.531486 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=100 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:22.537617 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-784e94db-3da1-4986-852a-22c5a5401c29 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:22.538071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-784e94db-3da1-4986-852a-22c5a5401c29 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:22.538859 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-784e94db-3da1-4986-852a-22c5a5401c29 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:22.539304 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-784e94db-3da1-4986-852a-22c5a5401c29 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:22.781502 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-784e94db-3da1-4986-852a-22c5a5401c29 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:22.797625 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-784e94db-3da1-4986-852a-22c5a5401c29 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1368 microversion: 2.1 time: 0.275971 May 23 16:46:22.805531 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 71/143] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:22 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1368 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:22.935234 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-6ff78143-923b-467c-9ce2-ede165ce71c2 req-35e6ebe1-cb12-46d3-ac0f-b3aa4e2fea7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "405bb8d2-37bb-47fc-9ea9-c432cc0bafd4", "tag": "d9215691-0275-40e1-bf02-9d9be4c9e0e9"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:46:22.954557 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-6ff78143-923b-467c-9ce2-ede165ce71c2 req-35e6ebe1-cb12-46d3-ac0f-b3aa4e2fea7e service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:22.959363 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-6ff78143-923b-467c-9ce2-ede165ce71c2 req-35e6ebe1-cb12-46d3-ac0f-b3aa4e2fea7e service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:22.981981 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-6ff78143-923b-467c-9ce2-ede165ce71c2 req-35e6ebe1-cb12-46d3-ac0f-b3aa4e2fea7e service nova] Creating event network-changed:d9215691-0275-40e1-bf02-9d9be4c9e0e9 for instance 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 on hv-cinder-83925 May 23 16:46:22.987190 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-6ff78143-923b-467c-9ce2-ede165ce71c2 req-35e6ebe1-cb12-46d3-ac0f-b3aa4e2fea7e service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057117 May 23 16:46:22.987807 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 73/144] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:46:23.089953 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-25253a18-e7af-4dc2-b849-861a198e6d22 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:23.090617 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-25253a18-e7af-4dc2-b849-861a198e6d22 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:23.112087 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-fddfe114-3df9-4889-b1ec-7406f6436453 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:23.113626 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-fddfe114-3df9-4889-b1ec-7406f6436453 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:23.113744 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-25253a18-e7af-4dc2-b849-861a198e6d22 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:23.115496 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-25253a18-e7af-4dc2-b849-861a198e6d22 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:23.120156 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-25253a18-e7af-4dc2-b849-861a198e6d22 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:23.120156 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-25253a18-e7af-4dc2-b849-861a198e6d22 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:23.123487 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fddfe114-3df9-4889-b1ec-7406f6436453 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:23.124079 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fddfe114-3df9-4889-b1ec-7406f6436453 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:23.130032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fddfe114-3df9-4889-b1ec-7406f6436453 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:23.130784 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fddfe114-3df9-4889-b1ec-7406f6436453 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:23.625830 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-25253a18-e7af-4dc2-b849-861a198e6d22 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:23.632930 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-fddfe114-3df9-4889-b1ec-7406f6436453 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:23.642964 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-fddfe114-3df9-4889-b1ec-7406f6436453 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:23.644485 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-fddfe114-3df9-4889-b1ec-7406f6436453 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:23.645588 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-fddfe114-3df9-4889-b1ec-7406f6436453 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1407 microversion: 2.20 time: 0.540462 May 23 16:46:23.651133 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-25253a18-e7af-4dc2-b849-861a198e6d22 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1363 microversion: 2.1 time: 0.564716 May 23 16:46:23.651708 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 72/146] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:23 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1363 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:23.657602 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 74/146] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:23 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1407 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:46:23.662639 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-536fdce2-dba2-43d1-b325-1fde58b8937e req-3f1f46cb-faf4-469d-96e8-1db4205cd021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead45718-a5be-4d14-a83c-b6101b5ebc3c", "name": "network-vif-plugged", "status": "completed", "tag": "9b6b2933-3180-4c87-a5e7-c75a56eb9704"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:46:23.663731 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-12ee9033-d4c2-49c6-8a3c-372045c89d3d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:23.669730 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-12ee9033-d4c2-49c6-8a3c-372045c89d3d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:23.673273 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-536fdce2-dba2-43d1-b325-1fde58b8937e req-3f1f46cb-faf4-469d-96e8-1db4205cd021 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:23.673723 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-536fdce2-dba2-43d1-b325-1fde58b8937e req-3f1f46cb-faf4-469d-96e8-1db4205cd021 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:23.675856 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-12ee9033-d4c2-49c6-8a3c-372045c89d3d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:23.676326 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-12ee9033-d4c2-49c6-8a3c-372045c89d3d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:23.677092 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-12ee9033-d4c2-49c6-8a3c-372045c89d3d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:23.677527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-12ee9033-d4c2-49c6-8a3c-372045c89d3d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:23.686151 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-536fdce2-dba2-43d1-b325-1fde58b8937e req-3f1f46cb-faf4-469d-96e8-1db4205cd021 service nova] Creating event network-vif-plugged:9b6b2933-3180-4c87-a5e7-c75a56eb9704 for instance ead45718-a5be-4d14-a83c-b6101b5ebc3c on hv-cinder-83925 May 23 16:46:23.691270 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-536fdce2-dba2-43d1-b325-1fde58b8937e req-3f1f46cb-faf4-469d-96e8-1db4205cd021 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038126 May 23 16:46:23.692380 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 73/147] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:46:23.698363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-bbaf4864-c7c0-4468-a6eb-d98e9a42c6ad tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dab1f980-dbf8-4594-a26e-27a01b233ae7"}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:46:23.699503 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-bbaf4864-c7c0-4468-a6eb-d98e9a42c6ad tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:23.706552 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bbaf4864-c7c0-4468-a6eb-d98e9a42c6ad tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:23.707035 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bbaf4864-c7c0-4468-a6eb-d98e9a42c6ad tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:23.707881 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bbaf4864-c7c0-4468-a6eb-d98e9a42c6ad tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:23.708391 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bbaf4864-c7c0-4468-a6eb-d98e9a42c6ad tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:23.868337 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-12ee9033-d4c2-49c6-8a3c-372045c89d3d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:23.879367 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-12ee9033-d4c2-49c6-8a3c-372045c89d3d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1322 microversion: 2.1 time: 0.219668 May 23 16:46:23.880165 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 75/148] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:23 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:23.886113 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c149450a-a3e8-439c-812e-277ac43c6602 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:23.887098 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-c149450a-a3e8-439c-812e-277ac43c6602 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:23.895552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c149450a-a3e8-439c-812e-277ac43c6602 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:23.896093 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c149450a-a3e8-439c-812e-277ac43c6602 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:23.896985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c149450a-a3e8-439c-812e-277ac43c6602 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:23.897501 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c149450a-a3e8-439c-812e-277ac43c6602 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:24.036539 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-c149450a-a3e8-439c-812e-277ac43c6602 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:24.044740 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-c149450a-a3e8-439c-812e-277ac43c6602 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1368 microversion: 2.1 time: 0.163412 May 23 16:46:24.045432 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 76/149] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:23 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:24.668837 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-00186573-8a22-44c5-a36e-7c9e927477f0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:24.669467 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-00186573-8a22-44c5-a36e-7c9e927477f0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:24.675631 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-00186573-8a22-44c5-a36e-7c9e927477f0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:24.676084 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-00186573-8a22-44c5-a36e-7c9e927477f0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:24.676890 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-00186573-8a22-44c5-a36e-7c9e927477f0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:24.677328 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-00186573-8a22-44c5-a36e-7c9e927477f0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:24.812392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-00186573-8a22-44c5-a36e-7c9e927477f0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:24.821715 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-00186573-8a22-44c5-a36e-7c9e927477f0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1363 microversion: 2.1 time: 0.157982 May 23 16:46:24.822478 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 77/150] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:24 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:24.829218 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-090aec78-4005-4657-84e8-ea0f9d917c10 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:24.829831 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-090aec78-4005-4657-84e8-ea0f9d917c10 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:24.835915 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-090aec78-4005-4657-84e8-ea0f9d917c10 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:24.836315 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-090aec78-4005-4657-84e8-ea0f9d917c10 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:24.837110 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-090aec78-4005-4657-84e8-ea0f9d917c10 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:24.837547 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-090aec78-4005-4657-84e8-ea0f9d917c10 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:25.005438 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-090aec78-4005-4657-84e8-ea0f9d917c10 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:25.014546 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-090aec78-4005-4657-84e8-ea0f9d917c10 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:25.016066 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-090aec78-4005-4657-84e8-ea0f9d917c10 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:25.017289 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-090aec78-4005-4657-84e8-ea0f9d917c10 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1407 microversion: 2.20 time: 0.193653 May 23 16:46:25.017859 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 78/151] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:24 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:46:25.027918 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-67d8548e-dcf2-4ab3-8a2c-ee0d0f5124a8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:25.028767 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-67d8548e-dcf2-4ab3-8a2c-ee0d0f5124a8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:25.036954 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-67d8548e-dcf2-4ab3-8a2c-ee0d0f5124a8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:25.037509 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-67d8548e-dcf2-4ab3-8a2c-ee0d0f5124a8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:25.038593 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-67d8548e-dcf2-4ab3-8a2c-ee0d0f5124a8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:25.039106 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-67d8548e-dcf2-4ab3-8a2c-ee0d0f5124a8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:25.178965 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-67d8548e-dcf2-4ab3-8a2c-ee0d0f5124a8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:25.186374 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-67d8548e-dcf2-4ab3-8a2c-ee0d0f5124a8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1322 microversion: 2.1 time: 0.167501 May 23 16:46:25.186966 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 79/152] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:25 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:25.191406 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-65fd8ac1-a4f0-4138-851c-871befb63393 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:25.192016 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-65fd8ac1-a4f0-4138-851c-871befb63393 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:25.200264 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-65fd8ac1-a4f0-4138-851c-871befb63393 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:25.200780 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-65fd8ac1-a4f0-4138-851c-871befb63393 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:25.201557 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-65fd8ac1-a4f0-4138-851c-871befb63393 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:25.201995 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-65fd8ac1-a4f0-4138-851c-871befb63393 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:25.365219 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-65fd8ac1-a4f0-4138-851c-871befb63393 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:25.373136 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-65fd8ac1-a4f0-4138-851c-871befb63393 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1368 microversion: 2.1 time: 0.185215 May 23 16:46:25.373745 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 80/153] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:25 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:25.541995 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=100 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:25.840124 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-35671c3d-73a1-4b0c-8337-77347d049665 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:25.840945 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-35671c3d-73a1-4b0c-8337-77347d049665 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:25.848371 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-35671c3d-73a1-4b0c-8337-77347d049665 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:25.849648 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-35671c3d-73a1-4b0c-8337-77347d049665 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:25.851156 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-35671c3d-73a1-4b0c-8337-77347d049665 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:25.852193 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-35671c3d-73a1-4b0c-8337-77347d049665 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:26.057386 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-35671c3d-73a1-4b0c-8337-77347d049665 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:26.067701 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-35671c3d-73a1-4b0c-8337-77347d049665 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1363 microversion: 2.1 time: 0.232467 May 23 16:46:26.068316 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 81/154] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:25 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:26.074323 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-d27df21c-625b-47db-a34d-12705c1c0978 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:26.074936 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-d27df21c-625b-47db-a34d-12705c1c0978 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:26.081189 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d27df21c-625b-47db-a34d-12705c1c0978 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:26.081637 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d27df21c-625b-47db-a34d-12705c1c0978 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:26.082409 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d27df21c-625b-47db-a34d-12705c1c0978 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:26.082829 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d27df21c-625b-47db-a34d-12705c1c0978 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:26.092760 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=100 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:26.244650 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d27df21c-625b-47db-a34d-12705c1c0978 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:26.254611 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d27df21c-625b-47db-a34d-12705c1c0978 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:26.256473 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d27df21c-625b-47db-a34d-12705c1c0978 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:26.257734 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-d27df21c-625b-47db-a34d-12705c1c0978 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1407 microversion: 2.20 time: 0.188339 May 23 16:46:26.282082 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 82/155] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:26 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:46:26.287145 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-f588bbf1-ff3a-4a63-b49c-e1944dc4a303 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:26.287751 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-f588bbf1-ff3a-4a63-b49c-e1944dc4a303 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:26.294269 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f588bbf1-ff3a-4a63-b49c-e1944dc4a303 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:26.294631 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f588bbf1-ff3a-4a63-b49c-e1944dc4a303 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:26.295394 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f588bbf1-ff3a-4a63-b49c-e1944dc4a303 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:26.295826 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f588bbf1-ff3a-4a63-b49c-e1944dc4a303 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:26.348543 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-bbaf4864-c7c0-4468-a6eb-d98e9a42c6ad tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "POST /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.654595 May 23 16:46:26.349176 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 74/156] 10.222.0.74 () {60 vars in 1322 bytes} [Mon May 23 16:46:23 2022] POST /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920/os-volume_attachments => generated 194 bytes in 2656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:46:26.392059 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-c042c509-eff1-4b52-8469-209a1e87a69b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:26.392792 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-c042c509-eff1-4b52-8469-209a1e87a69b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:26.399718 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c042c509-eff1-4b52-8469-209a1e87a69b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:26.400615 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c042c509-eff1-4b52-8469-209a1e87a69b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:26.401675 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c042c509-eff1-4b52-8469-209a1e87a69b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:26.402374 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c042c509-eff1-4b52-8469-209a1e87a69b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:26.456913 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f588bbf1-ff3a-4a63-b49c-e1944dc4a303 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:26.465729 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-f588bbf1-ff3a-4a63-b49c-e1944dc4a303 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1515 microversion: 2.1 time: 0.182233 May 23 16:46:26.466333 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 83/157] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:26 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:26.485803 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-5e7e8f8a-0aeb-4168-9620-8adab29b01e3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:46:26.487958 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-5e7e8f8a-0aeb-4168-9620-8adab29b01e3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:26.506380 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5e7e8f8a-0aeb-4168-9620-8adab29b01e3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:26.511063 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5e7e8f8a-0aeb-4168-9620-8adab29b01e3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:26.513401 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5e7e8f8a-0aeb-4168-9620-8adab29b01e3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:26.514004 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5e7e8f8a-0aeb-4168-9620-8adab29b01e3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:26.594292 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-c042c509-eff1-4b52-8469-209a1e87a69b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:26.603148 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-c042c509-eff1-4b52-8469-209a1e87a69b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1368 microversion: 2.1 time: 0.215747 May 23 16:46:26.604214 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 75/158] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:26 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:26.739138 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.objects.instance [None req-5e7e8f8a-0aeb-4168-9620-8adab29b01e3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lazy-loading 'flavor' on Instance uuid ff5e6ec2-b063-4631-9582-9d94a739d3b7 {{(pid=124715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:46:27.086880 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-82deeb16-ba09-48b1-b777-cacfd258cac4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:27.087504 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-82deeb16-ba09-48b1-b777-cacfd258cac4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:27.093897 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-82deeb16-ba09-48b1-b777-cacfd258cac4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:27.094357 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-82deeb16-ba09-48b1-b777-cacfd258cac4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:27.095136 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-82deeb16-ba09-48b1-b777-cacfd258cac4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:27.095647 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-82deeb16-ba09-48b1-b777-cacfd258cac4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:27.150086 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-5e7e8f8a-0aeb-4168-9620-8adab29b01e3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "POST /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7/action" status: 200 len: 32 microversion: 2.1 time: 0.668975 May 23 16:46:27.156173 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 84/159] 10.222.0.74 () {60 vars in 1277 bytes} [Mon May 23 16:46:26 2022] POST /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7/action => generated 32 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 16:46:27.166549 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-68bda094-c2cb-4403-abc3-f9a5c06cbc19 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:27.178654 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-68bda094-c2cb-4403-abc3-f9a5c06cbc19 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:27.205017 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-68bda094-c2cb-4403-abc3-f9a5c06cbc19 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:27.208196 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-68bda094-c2cb-4403-abc3-f9a5c06cbc19 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:27.210878 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-68bda094-c2cb-4403-abc3-f9a5c06cbc19 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:27.215569 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-68bda094-c2cb-4403-abc3-f9a5c06cbc19 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:27.284043 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-82deeb16-ba09-48b1-b777-cacfd258cac4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:27.298153 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-82deeb16-ba09-48b1-b777-cacfd258cac4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1363 microversion: 2.1 time: 0.215575 May 23 16:46:27.307539 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 76/160] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:27 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:27.314275 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-4dc6ecf7-ea42-4944-bb95-6cd669dee5c8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:27.314898 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-4dc6ecf7-ea42-4944-bb95-6cd669dee5c8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:27.325835 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4dc6ecf7-ea42-4944-bb95-6cd669dee5c8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:27.325835 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4dc6ecf7-ea42-4944-bb95-6cd669dee5c8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:27.325835 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4dc6ecf7-ea42-4944-bb95-6cd669dee5c8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:27.325835 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4dc6ecf7-ea42-4944-bb95-6cd669dee5c8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:27.520323 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-68bda094-c2cb-4403-abc3-f9a5c06cbc19 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:27.530697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-68bda094-c2cb-4403-abc3-f9a5c06cbc19 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.370288 May 23 16:46:27.547811 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 85/161] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:27 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:27.621900 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e023fcac-b63a-400e-b769-9dddb91c0260 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:27.622594 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e023fcac-b63a-400e-b769-9dddb91c0260 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:27.640353 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e023fcac-b63a-400e-b769-9dddb91c0260 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:27.640820 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e023fcac-b63a-400e-b769-9dddb91c0260 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:27.641602 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e023fcac-b63a-400e-b769-9dddb91c0260 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:27.642230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e023fcac-b63a-400e-b769-9dddb91c0260 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:27.647976 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-4dc6ecf7-ea42-4944-bb95-6cd669dee5c8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:27.659451 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-4dc6ecf7-ea42-4944-bb95-6cd669dee5c8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:27.661114 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-4dc6ecf7-ea42-4944-bb95-6cd669dee5c8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:27.662286 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-4dc6ecf7-ea42-4944-bb95-6cd669dee5c8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1407 microversion: 2.20 time: 0.352410 May 23 16:46:27.672438 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 77/162] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:27 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:46:27.793782 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e023fcac-b63a-400e-b769-9dddb91c0260 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:27.802267 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e023fcac-b63a-400e-b769-9dddb91c0260 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1368 microversion: 2.1 time: 0.185621 May 23 16:46:27.802853 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 86/163] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:27 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:28.316334 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-2df5162a-cef3-4349-b08f-5c819c2d1d1d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:28.316955 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-2df5162a-cef3-4349-b08f-5c819c2d1d1d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:28.323150 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2df5162a-cef3-4349-b08f-5c819c2d1d1d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:28.323600 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2df5162a-cef3-4349-b08f-5c819c2d1d1d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:28.324391 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2df5162a-cef3-4349-b08f-5c819c2d1d1d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:28.324854 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2df5162a-cef3-4349-b08f-5c819c2d1d1d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:28.554996 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c5bb42f8-9e03-456a-9c1c-fb5c71d642f6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:28.555621 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-c5bb42f8-9e03-456a-9c1c-fb5c71d642f6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:28.562758 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c5bb42f8-9e03-456a-9c1c-fb5c71d642f6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:28.563212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c5bb42f8-9e03-456a-9c1c-fb5c71d642f6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:28.564766 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c5bb42f8-9e03-456a-9c1c-fb5c71d642f6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:28.565210 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c5bb42f8-9e03-456a-9c1c-fb5c71d642f6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:28.666849 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-2df5162a-cef3-4349-b08f-5c819c2d1d1d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:28.684236 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-2df5162a-cef3-4349-b08f-5c819c2d1d1d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1363 microversion: 2.1 time: 0.370583 May 23 16:46:28.685061 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 78/164] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:28 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1363 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:28.699975 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-a5a69927-bcce-40e6-912d-9f2f8ec441e2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:28.700917 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-a5a69927-bcce-40e6-912d-9f2f8ec441e2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:28.708699 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a5a69927-bcce-40e6-912d-9f2f8ec441e2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:28.709603 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a5a69927-bcce-40e6-912d-9f2f8ec441e2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:28.710592 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a5a69927-bcce-40e6-912d-9f2f8ec441e2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:28.711256 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a5a69927-bcce-40e6-912d-9f2f8ec441e2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:28.813305 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-c5bb42f8-9e03-456a-9c1c-fb5c71d642f6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:28.821304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-c5bb42f8-9e03-456a-9c1c-fb5c71d642f6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.270853 May 23 16:46:28.822190 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 87/165] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:28 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:28.828231 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-6f914112-fe84-47d9-b4b7-5c000997ab5e tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:28.829146 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-6f914112-fe84-47d9-b4b7-5c000997ab5e tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:28.837377 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6f914112-fe84-47d9-b4b7-5c000997ab5e tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:28.838509 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6f914112-fe84-47d9-b4b7-5c000997ab5e tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:28.839684 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6f914112-fe84-47d9-b4b7-5c000997ab5e tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:28.840217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6f914112-fe84-47d9-b4b7-5c000997ab5e tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:29.046676 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-a5a69927-bcce-40e6-912d-9f2f8ec441e2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:29.058483 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-a5a69927-bcce-40e6-912d-9f2f8ec441e2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:29.065503 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-a5a69927-bcce-40e6-912d-9f2f8ec441e2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:29.071056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-a5a69927-bcce-40e6-912d-9f2f8ec441e2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1407 microversion: 2.20 time: 0.382635 May 23 16:46:29.071815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 79/166] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:28 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1407 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:46:29.077329 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-6f914112-fe84-47d9-b4b7-5c000997ab5e tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:29.085749 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-6f914112-fe84-47d9-b4b7-5c000997ab5e tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1559 microversion: 2.1 time: 0.262150 May 23 16:46:29.092429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 88/167] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:28 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1559 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:29.104101 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-7bc9c2c0-bb96-4c84-b04f-36ee09cbd5e0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:29.104840 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-7bc9c2c0-bb96-4c84-b04f-36ee09cbd5e0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:29.111482 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7bc9c2c0-bb96-4c84-b04f-36ee09cbd5e0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:29.112025 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7bc9c2c0-bb96-4c84-b04f-36ee09cbd5e0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:29.112847 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7bc9c2c0-bb96-4c84-b04f-36ee09cbd5e0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:29.113289 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7bc9c2c0-bb96-4c84-b04f-36ee09cbd5e0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:29.246403 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-7bc9c2c0-bb96-4c84-b04f-36ee09cbd5e0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.140743 May 23 16:46:29.247149 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 80/168] 10.222.0.74 () {58 vars in 1274 bytes} [Mon May 23 16:46:29 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c/os-interface => generated 285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:46:29.430873 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-8a525049-fc68-4c8d-8303-6faa751f7578 req-8ae698f0-5b5e-4897-8185-746423b5d8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb302c29-c30d-4ffa-af9d-1f226fd56357", "name": "network-vif-plugged", "status": "completed", "tag": "bd409a76-162e-44c7-9e54-76b5e47accda"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:46:29.448595 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-8a525049-fc68-4c8d-8303-6faa751f7578 req-8ae698f0-5b5e-4897-8185-746423b5d8b8 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:29.450240 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-8a525049-fc68-4c8d-8303-6faa751f7578 req-8ae698f0-5b5e-4897-8185-746423b5d8b8 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:29.462223 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-8a525049-fc68-4c8d-8303-6faa751f7578 req-8ae698f0-5b5e-4897-8185-746423b5d8b8 service nova] Creating event network-vif-plugged:bd409a76-162e-44c7-9e54-76b5e47accda for instance bb302c29-c30d-4ffa-af9d-1f226fd56357 on hv-cinder-83925 May 23 16:46:29.467572 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-8a525049-fc68-4c8d-8303-6faa751f7578 req-8ae698f0-5b5e-4897-8185-746423b5d8b8 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040944 May 23 16:46:29.468688 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 89/169] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:46:29.703765 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-fb88164b-701e-49d8-9bb4-6efb1dd12064 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:29.704409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-fb88164b-701e-49d8-9bb4-6efb1dd12064 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:29.712557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fb88164b-701e-49d8-9bb4-6efb1dd12064 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:29.713193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fb88164b-701e-49d8-9bb4-6efb1dd12064 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:29.714188 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fb88164b-701e-49d8-9bb4-6efb1dd12064 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:29.714809 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fb88164b-701e-49d8-9bb4-6efb1dd12064 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:29.840128 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-ad9a8ad9-86b8-4f1c-97e8-05f0571dc60f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:29.841390 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-ad9a8ad9-86b8-4f1c-97e8-05f0571dc60f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:29.848968 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ad9a8ad9-86b8-4f1c-97e8-05f0571dc60f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:29.850246 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ad9a8ad9-86b8-4f1c-97e8-05f0571dc60f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:29.850246 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ad9a8ad9-86b8-4f1c-97e8-05f0571dc60f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:29.850821 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ad9a8ad9-86b8-4f1c-97e8-05f0571dc60f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:30.322893 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-fb88164b-701e-49d8-9bb4-6efb1dd12064 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:30.331099 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-fb88164b-701e-49d8-9bb4-6efb1dd12064 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1363 microversion: 2.1 time: 0.632756 May 23 16:46:30.331685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 81/170] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:29 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1363 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:30.357745 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-94ddabf1-90ad-48a1-b24a-56d7a1bd71e0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:30.368686 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-94ddabf1-90ad-48a1-b24a-56d7a1bd71e0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:30.368686 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-94ddabf1-90ad-48a1-b24a-56d7a1bd71e0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:30.368686 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-94ddabf1-90ad-48a1-b24a-56d7a1bd71e0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:30.368686 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-94ddabf1-90ad-48a1-b24a-56d7a1bd71e0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:30.369290 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-94ddabf1-90ad-48a1-b24a-56d7a1bd71e0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:30.389526 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-ad9a8ad9-86b8-4f1c-97e8-05f0571dc60f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:30.397409 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-ad9a8ad9-86b8-4f1c-97e8-05f0571dc60f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.562021 May 23 16:46:30.398082 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 90/171] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:29 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:30.542342 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-94ddabf1-90ad-48a1-b24a-56d7a1bd71e0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:30.551462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-94ddabf1-90ad-48a1-b24a-56d7a1bd71e0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:30.553607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-94ddabf1-90ad-48a1-b24a-56d7a1bd71e0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:30.554837 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-94ddabf1-90ad-48a1-b24a-56d7a1bd71e0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1407 microversion: 2.20 time: 0.201477 May 23 16:46:30.566001 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 82/172] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:30 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:46:30.944566 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-9d615717-51c6-4481-91c2-6cdc698ebdba req-ddc8d98c-811e-4bff-aff5-11ec3ea7adf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ead45718-a5be-4d14-a83c-b6101b5ebc3c", "tag": "9b6b2933-3180-4c87-a5e7-c75a56eb9704"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:46:30.953747 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-9d615717-51c6-4481-91c2-6cdc698ebdba req-ddc8d98c-811e-4bff-aff5-11ec3ea7adf8 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:30.954182 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-9d615717-51c6-4481-91c2-6cdc698ebdba req-ddc8d98c-811e-4bff-aff5-11ec3ea7adf8 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:30.966951 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-9d615717-51c6-4481-91c2-6cdc698ebdba req-ddc8d98c-811e-4bff-aff5-11ec3ea7adf8 service nova] Creating event network-changed:9b6b2933-3180-4c87-a5e7-c75a56eb9704 for instance ead45718-a5be-4d14-a83c-b6101b5ebc3c on hv-cinder-83925 May 23 16:46:30.972152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-9d615717-51c6-4481-91c2-6cdc698ebdba req-ddc8d98c-811e-4bff-aff5-11ec3ea7adf8 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031563 May 23 16:46:30.972774 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 91/173] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:46:31.355771 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-dc0674cf-147d-40bf-acc5-8abdd9f80a52 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:31.355771 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-dc0674cf-147d-40bf-acc5-8abdd9f80a52 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:31.382674 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dc0674cf-147d-40bf-acc5-8abdd9f80a52 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:31.383772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dc0674cf-147d-40bf-acc5-8abdd9f80a52 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:31.387743 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dc0674cf-147d-40bf-acc5-8abdd9f80a52 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:31.389530 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dc0674cf-147d-40bf-acc5-8abdd9f80a52 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:31.421537 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-6a35e916-38b2-4d91-9587-1ebc9d5cfb8a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:31.422261 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-6a35e916-38b2-4d91-9587-1ebc9d5cfb8a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:31.452607 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a35e916-38b2-4d91-9587-1ebc9d5cfb8a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:31.452607 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a35e916-38b2-4d91-9587-1ebc9d5cfb8a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:31.453702 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a35e916-38b2-4d91-9587-1ebc9d5cfb8a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:31.453702 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a35e916-38b2-4d91-9587-1ebc9d5cfb8a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:31.878171 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-6a35e916-38b2-4d91-9587-1ebc9d5cfb8a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:31.883725 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-dc0674cf-147d-40bf-acc5-8abdd9f80a52 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:31.893418 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-dc0674cf-147d-40bf-acc5-8abdd9f80a52 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1363 microversion: 2.1 time: 0.548908 May 23 16:46:31.893599 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-6a35e916-38b2-4d91-9587-1ebc9d5cfb8a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.482250 May 23 16:46:31.894111 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 92/174] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:31 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:31.901211 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 83/175] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:31 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1363 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:31.928716 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-774b455c-4018-4147-b3fb-b34572dbb9de tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:31.928716 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-774b455c-4018-4147-b3fb-b34572dbb9de tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:31.928716 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-774b455c-4018-4147-b3fb-b34572dbb9de tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:31.928716 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-774b455c-4018-4147-b3fb-b34572dbb9de tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:31.930940 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-774b455c-4018-4147-b3fb-b34572dbb9de tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:31.930940 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-774b455c-4018-4147-b3fb-b34572dbb9de tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:32.341906 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-774b455c-4018-4147-b3fb-b34572dbb9de tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:32.350930 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-774b455c-4018-4147-b3fb-b34572dbb9de tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:32.352470 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-774b455c-4018-4147-b3fb-b34572dbb9de tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:32.359184 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-774b455c-4018-4147-b3fb-b34572dbb9de tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1407 microversion: 2.20 time: 0.453670 May 23 16:46:32.359779 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 93/176] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:31 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1407 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:46:32.910826 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-b0325912-8b51-4655-9bdb-04aaf7dbc614 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:32.911546 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-b0325912-8b51-4655-9bdb-04aaf7dbc614 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:32.927596 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b0325912-8b51-4655-9bdb-04aaf7dbc614 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:32.928808 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b0325912-8b51-4655-9bdb-04aaf7dbc614 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:32.929705 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-f61eefbd-55e6-4e5a-a85d-18cd4ba72cfb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:32.930327 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-f61eefbd-55e6-4e5a-a85d-18cd4ba72cfb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:32.931299 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b0325912-8b51-4655-9bdb-04aaf7dbc614 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:32.935878 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b0325912-8b51-4655-9bdb-04aaf7dbc614 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:32.938633 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f61eefbd-55e6-4e5a-a85d-18cd4ba72cfb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:32.939275 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f61eefbd-55e6-4e5a-a85d-18cd4ba72cfb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:32.941215 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f61eefbd-55e6-4e5a-a85d-18cd4ba72cfb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:32.941842 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f61eefbd-55e6-4e5a-a85d-18cd4ba72cfb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:33.162732 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f61eefbd-55e6-4e5a-a85d-18cd4ba72cfb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:33.172950 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-f61eefbd-55e6-4e5a-a85d-18cd4ba72cfb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1363 microversion: 2.1 time: 0.247951 May 23 16:46:33.173544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 94/177] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:32 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:33.175377 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b0325912-8b51-4655-9bdb-04aaf7dbc614 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:33.184224 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-b0325912-8b51-4655-9bdb-04aaf7dbc614 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.277143 May 23 16:46:33.184945 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 84/178] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:32 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:33.377514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-d8532abe-fa63-464d-b401-3cd15ed60b22 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:33.378162 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-d8532abe-fa63-464d-b401-3cd15ed60b22 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:33.384132 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d8532abe-fa63-464d-b401-3cd15ed60b22 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:33.385262 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d8532abe-fa63-464d-b401-3cd15ed60b22 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:33.386099 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d8532abe-fa63-464d-b401-3cd15ed60b22 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:33.386544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d8532abe-fa63-464d-b401-3cd15ed60b22 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:33.514318 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d8532abe-fa63-464d-b401-3cd15ed60b22 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:33.522211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d8532abe-fa63-464d-b401-3cd15ed60b22 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:33.523768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d8532abe-fa63-464d-b401-3cd15ed60b22 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:33.524893 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-d8532abe-fa63-464d-b401-3cd15ed60b22 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1407 microversion: 2.20 time: 0.151459 May 23 16:46:33.525448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 95/179] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:33 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:46:34.192363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-bcd5cd8b-d240-4476-bc02-bf7e47259c4e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:34.193990 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-bcd5cd8b-d240-4476-bc02-bf7e47259c4e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:34.202617 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-bdb22bae-eff2-4d7c-8d22-8d890291a0ed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:34.203188 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bcd5cd8b-d240-4476-bc02-bf7e47259c4e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:34.203294 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-bdb22bae-eff2-4d7c-8d22-8d890291a0ed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:34.203643 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bcd5cd8b-d240-4476-bc02-bf7e47259c4e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:34.204675 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bcd5cd8b-d240-4476-bc02-bf7e47259c4e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:34.205259 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bcd5cd8b-d240-4476-bc02-bf7e47259c4e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:34.209340 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bdb22bae-eff2-4d7c-8d22-8d890291a0ed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:34.209788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bdb22bae-eff2-4d7c-8d22-8d890291a0ed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:34.210556 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bdb22bae-eff2-4d7c-8d22-8d890291a0ed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:34.210992 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bdb22bae-eff2-4d7c-8d22-8d890291a0ed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:34.425690 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-bcd5cd8b-d240-4476-bc02-bf7e47259c4e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:34.433383 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-bcd5cd8b-d240-4476-bc02-bf7e47259c4e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1363 microversion: 2.1 time: 0.246861 May 23 16:46:34.434218 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 85/180] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:34 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:34.444694 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-bdb22bae-eff2-4d7c-8d22-8d890291a0ed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:34.453157 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-bdb22bae-eff2-4d7c-8d22-8d890291a0ed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.254653 May 23 16:46:34.462516 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 96/181] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:34 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:34.542536 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-fd93cac8-5e1d-48bf-8f91-5d65e5f98180 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:34.543143 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-fd93cac8-5e1d-48bf-8f91-5d65e5f98180 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:34.549218 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fd93cac8-5e1d-48bf-8f91-5d65e5f98180 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:34.549664 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fd93cac8-5e1d-48bf-8f91-5d65e5f98180 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:34.550426 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fd93cac8-5e1d-48bf-8f91-5d65e5f98180 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:34.550861 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fd93cac8-5e1d-48bf-8f91-5d65e5f98180 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:34.685206 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-fd93cac8-5e1d-48bf-8f91-5d65e5f98180 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:34.691599 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-fd93cac8-5e1d-48bf-8f91-5d65e5f98180 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:34.693208 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-fd93cac8-5e1d-48bf-8f91-5d65e5f98180 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:34.694390 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-fd93cac8-5e1d-48bf-8f91-5d65e5f98180 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1599 microversion: 2.20 time: 0.155926 May 23 16:46:34.695047 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 86/182] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:46:34 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:46:34.713391 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-0ead6c7e-73dd-4017-b36d-8fe76fca5e7c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:34.716139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-0ead6c7e-73dd-4017-b36d-8fe76fca5e7c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:34.720422 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0ead6c7e-73dd-4017-b36d-8fe76fca5e7c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:34.720883 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0ead6c7e-73dd-4017-b36d-8fe76fca5e7c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:34.721988 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0ead6c7e-73dd-4017-b36d-8fe76fca5e7c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:34.722450 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0ead6c7e-73dd-4017-b36d-8fe76fca5e7c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:34.811079 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-0ead6c7e-73dd-4017-b36d-8fe76fca5e7c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.101498 May 23 16:46:34.811721 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 97/183] 10.222.0.74 () {60 vars in 1315 bytes} [Mon May 23 16:46:34 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 16:46:35.286633 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-d4ca8222-9765-4d86-bb7c-dc38a6219b5a req-ff1762a0-49f5-4368-aeac-32b1ae681be2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "405bb8d2-37bb-47fc-9ea9-c432cc0bafd4", "name": "network-vif-plugged", "status": "completed", "tag": "d9215691-0275-40e1-bf02-9d9be4c9e0e9"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:46:35.301676 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-d4ca8222-9765-4d86-bb7c-dc38a6219b5a req-ff1762a0-49f5-4368-aeac-32b1ae681be2 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:35.302122 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-d4ca8222-9765-4d86-bb7c-dc38a6219b5a req-ff1762a0-49f5-4368-aeac-32b1ae681be2 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:35.314974 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-d4ca8222-9765-4d86-bb7c-dc38a6219b5a req-ff1762a0-49f5-4368-aeac-32b1ae681be2 service nova] Creating event network-vif-plugged:d9215691-0275-40e1-bf02-9d9be4c9e0e9 for instance 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 on hv-cinder-83925 May 23 16:46:35.320278 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-d4ca8222-9765-4d86-bb7c-dc38a6219b5a req-ff1762a0-49f5-4368-aeac-32b1ae681be2 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038675 May 23 16:46:35.320898 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 87/184] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:46:35.451318 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-718b1c0e-40cb-4b9f-9bc9-5bbcaed5f6b0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:35.452827 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-718b1c0e-40cb-4b9f-9bc9-5bbcaed5f6b0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:35.472024 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-bc521810-c5b7-449d-9b93-3049690090b0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:35.473240 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-bc521810-c5b7-449d-9b93-3049690090b0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:35.478012 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-718b1c0e-40cb-4b9f-9bc9-5bbcaed5f6b0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:35.480717 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-718b1c0e-40cb-4b9f-9bc9-5bbcaed5f6b0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:35.482982 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bc521810-c5b7-449d-9b93-3049690090b0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:35.484685 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-718b1c0e-40cb-4b9f-9bc9-5bbcaed5f6b0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:35.485429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-718b1c0e-40cb-4b9f-9bc9-5bbcaed5f6b0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:35.488243 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bc521810-c5b7-449d-9b93-3049690090b0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:35.490011 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bc521810-c5b7-449d-9b93-3049690090b0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:35.495469 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bc521810-c5b7-449d-9b93-3049690090b0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:35.514903 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:36.046382 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-718b1c0e-40cb-4b9f-9bc9-5bbcaed5f6b0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:36.054273 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-bc521810-c5b7-449d-9b93-3049690090b0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:36.058607 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-718b1c0e-40cb-4b9f-9bc9-5bbcaed5f6b0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1363 microversion: 2.1 time: 0.611655 May 23 16:46:36.063756 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-bc521810-c5b7-449d-9b93-3049690090b0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.597241 May 23 16:46:36.064361 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 88/185] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:35 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:36.082822 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 98/186] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:35 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1363 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:36.433456 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-9c715e6b-b147-42c9-b800-763dbdb9fd42 req-fc769f01-160b-443a-bc01-8f70b7465bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb302c29-c30d-4ffa-af9d-1f226fd56357", "tag": "bd409a76-162e-44c7-9e54-76b5e47accda"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:46:36.443766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-9c715e6b-b147-42c9-b800-763dbdb9fd42 req-fc769f01-160b-443a-bc01-8f70b7465bb4 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:36.444218 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-9c715e6b-b147-42c9-b800-763dbdb9fd42 req-fc769f01-160b-443a-bc01-8f70b7465bb4 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:36.457550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-9c715e6b-b147-42c9-b800-763dbdb9fd42 req-fc769f01-160b-443a-bc01-8f70b7465bb4 service nova] Creating event network-changed:bd409a76-162e-44c7-9e54-76b5e47accda for instance bb302c29-c30d-4ffa-af9d-1f226fd56357 on hv-cinder-83925 May 23 16:46:36.464995 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-9c715e6b-b147-42c9-b800-763dbdb9fd42 req-fc769f01-160b-443a-bc01-8f70b7465bb4 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037356 May 23 16:46:36.465604 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 89/187] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:46:37.077643 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a8b92ac7-a4ff-4bd5-b7a3-0049284d38ea tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:37.078493 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a8b92ac7-a4ff-4bd5-b7a3-0049284d38ea tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:37.083703 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-7cf44eb9-bcd5-4275-a74c-a46cb298399d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:37.085655 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-7cf44eb9-bcd5-4275-a74c-a46cb298399d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:37.089652 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a8b92ac7-a4ff-4bd5-b7a3-0049284d38ea tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:37.091198 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a8b92ac7-a4ff-4bd5-b7a3-0049284d38ea tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:37.092346 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a8b92ac7-a4ff-4bd5-b7a3-0049284d38ea tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:37.095056 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a8b92ac7-a4ff-4bd5-b7a3-0049284d38ea tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:37.096805 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7cf44eb9-bcd5-4275-a74c-a46cb298399d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:37.097446 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7cf44eb9-bcd5-4275-a74c-a46cb298399d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:37.098695 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7cf44eb9-bcd5-4275-a74c-a46cb298399d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:37.100428 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7cf44eb9-bcd5-4275-a74c-a46cb298399d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:37.330932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a8b92ac7-a4ff-4bd5-b7a3-0049284d38ea tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:37.344260 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7cf44eb9-bcd5-4275-a74c-a46cb298399d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:37.344926 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a8b92ac7-a4ff-4bd5-b7a3-0049284d38ea tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1363 microversion: 2.1 time: 0.273331 May 23 16:46:37.345515 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 99/188] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:37 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:37.356096 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-7cf44eb9-bcd5-4275-a74c-a46cb298399d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.279006 May 23 16:46:37.356827 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 90/189] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:37 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:38.026430 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-f8fe04c1-f457-486b-8cfb-f43ede215661 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:38.026937 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-f8fe04c1-f457-486b-8cfb-f43ede215661 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:38.033137 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f8fe04c1-f457-486b-8cfb-f43ede215661 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:38.033588 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f8fe04c1-f457-486b-8cfb-f43ede215661 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:38.034552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f8fe04c1-f457-486b-8cfb-f43ede215661 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:38.034998 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f8fe04c1-f457-486b-8cfb-f43ede215661 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:38.062059 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-f8fe04c1-f457-486b-8cfb-f43ede215661 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Going to try to terminate instance {{(pid=124715) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 16:46:38.361943 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-2d54e933-c0ce-4ead-8a7b-99b68247c2fb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:38.362566 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-2d54e933-c0ce-4ead-8a7b-99b68247c2fb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:38.370274 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2d54e933-c0ce-4ead-8a7b-99b68247c2fb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:38.370730 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2d54e933-c0ce-4ead-8a7b-99b68247c2fb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:38.371512 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2d54e933-c0ce-4ead-8a7b-99b68247c2fb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:38.371956 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2d54e933-c0ce-4ead-8a7b-99b68247c2fb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:38.418075 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-f8fe04c1-f457-486b-8cfb-f43ede215661 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "DELETE /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 204 len: 0 microversion: 2.1 time: 0.395785 May 23 16:46:38.419561 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 100/190] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 16:46:38 2022] DELETE /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 16:46:38.426372 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-1064a42d-44f2-4580-8140-a1f9552a6089 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:38.427212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-1064a42d-44f2-4580-8140-a1f9552a6089 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:38.434342 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1064a42d-44f2-4580-8140-a1f9552a6089 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:38.434786 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1064a42d-44f2-4580-8140-a1f9552a6089 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:38.435721 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1064a42d-44f2-4580-8140-a1f9552a6089 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:38.436150 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1064a42d-44f2-4580-8140-a1f9552a6089 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:38.554048 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-2d54e933-c0ce-4ead-8a7b-99b68247c2fb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:38.561966 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-2d54e933-c0ce-4ead-8a7b-99b68247c2fb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1363 microversion: 2.1 time: 0.203818 May 23 16:46:38.562537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 91/191] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:38 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:38.567303 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-3dd2bbf6-603a-4f3a-93f6-709d3c220cb4 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:38.576289 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-3dd2bbf6-603a-4f3a-93f6-709d3c220cb4 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:38.576289 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3dd2bbf6-603a-4f3a-93f6-709d3c220cb4 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:38.576289 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3dd2bbf6-603a-4f3a-93f6-709d3c220cb4 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:38.576289 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3dd2bbf6-603a-4f3a-93f6-709d3c220cb4 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:38.576637 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3dd2bbf6-603a-4f3a-93f6-709d3c220cb4 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:38.580456 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:38.605267 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-1064a42d-44f2-4580-8140-a1f9552a6089 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:38.612704 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-1064a42d-44f2-4580-8140-a1f9552a6089 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.190519 May 23 16:46:38.613268 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 101/192] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:38 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:38.705505 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-3dd2bbf6-603a-4f3a-93f6-709d3c220cb4 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:38.714302 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-3dd2bbf6-603a-4f3a-93f6-709d3c220cb4 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1553 microversion: 2.1 time: 0.150807 May 23 16:46:38.714875 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 92/193] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:38 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:39.578370 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c417f70e-d016-4f77-ad4f-14b7481d67c9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:39.578905 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-c417f70e-d016-4f77-ad4f-14b7481d67c9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:39.585343 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c417f70e-d016-4f77-ad4f-14b7481d67c9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:39.585809 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c417f70e-d016-4f77-ad4f-14b7481d67c9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:39.586565 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c417f70e-d016-4f77-ad4f-14b7481d67c9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:39.587014 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c417f70e-d016-4f77-ad4f-14b7481d67c9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:39.637591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-da1d866e-f2f5-4a22-9205-3abc160eee11 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:39.638217 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-da1d866e-f2f5-4a22-9205-3abc160eee11 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:39.646437 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-da1d866e-f2f5-4a22-9205-3abc160eee11 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:39.646897 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-da1d866e-f2f5-4a22-9205-3abc160eee11 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:39.647680 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-da1d866e-f2f5-4a22-9205-3abc160eee11 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:39.648123 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-da1d866e-f2f5-4a22-9205-3abc160eee11 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:39.765030 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-c417f70e-d016-4f77-ad4f-14b7481d67c9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:39.772537 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-c417f70e-d016-4f77-ad4f-14b7481d67c9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1363 microversion: 2.1 time: 0.198297 May 23 16:46:39.773175 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 102/194] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:39 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:39.777599 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-9addeb7b-3daa-4829-afb0-989b3bc92950 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:39.778197 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-9addeb7b-3daa-4829-afb0-989b3bc92950 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:39.785747 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9addeb7b-3daa-4829-afb0-989b3bc92950 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:39.785747 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9addeb7b-3daa-4829-afb0-989b3bc92950 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:39.785747 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9addeb7b-3daa-4829-afb0-989b3bc92950 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:39.785747 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9addeb7b-3daa-4829-afb0-989b3bc92950 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:39.810206 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-da1d866e-f2f5-4a22-9205-3abc160eee11 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:39.818009 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-da1d866e-f2f5-4a22-9205-3abc160eee11 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.184471 May 23 16:46:39.818670 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 93/195] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:39 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:39.913675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-9addeb7b-3daa-4829-afb0-989b3bc92950 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:39.922700 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-9addeb7b-3daa-4829-afb0-989b3bc92950 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1553 microversion: 2.1 time: 0.148573 May 23 16:46:39.923326 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 103/196] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:39 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:40.788944 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-e2f48ce7-648a-49a4-9faa-319da0a1f124 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:40.789990 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-e2f48ce7-648a-49a4-9faa-319da0a1f124 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:40.797626 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e2f48ce7-648a-49a4-9faa-319da0a1f124 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:40.798146 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e2f48ce7-648a-49a4-9faa-319da0a1f124 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:40.798848 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e2f48ce7-648a-49a4-9faa-319da0a1f124 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:40.799284 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e2f48ce7-648a-49a4-9faa-319da0a1f124 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:40.834941 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-bb46bdae-62f7-4939-8566-878887d1ca64 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:40.835545 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-bb46bdae-62f7-4939-8566-878887d1ca64 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:40.842533 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bb46bdae-62f7-4939-8566-878887d1ca64 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:40.842983 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bb46bdae-62f7-4939-8566-878887d1ca64 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:40.843763 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bb46bdae-62f7-4939-8566-878887d1ca64 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:40.844195 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bb46bdae-62f7-4939-8566-878887d1ca64 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:40.983039 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e2f48ce7-648a-49a4-9faa-319da0a1f124 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:40.990644 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-e2f48ce7-648a-49a4-9faa-319da0a1f124 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1548 microversion: 2.1 time: 0.205541 May 23 16:46:40.991218 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 94/197] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:40 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1548 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:40.995757 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-7c5a8ed1-dafc-47ab-9b23-d455fa492205 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:40.996387 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-7c5a8ed1-dafc-47ab-9b23-d455fa492205 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:41.002302 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7c5a8ed1-dafc-47ab-9b23-d455fa492205 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:41.002663 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7c5a8ed1-dafc-47ab-9b23-d455fa492205 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:41.003435 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7c5a8ed1-dafc-47ab-9b23-d455fa492205 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:41.003868 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7c5a8ed1-dafc-47ab-9b23-d455fa492205 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:41.005459 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-bb46bdae-62f7-4939-8566-878887d1ca64 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:41.013769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-bb46bdae-62f7-4939-8566-878887d1ca64 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.182461 May 23 16:46:41.023215 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 104/198] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:40 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:41.028905 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-0976eb69-f816-4ec0-8880-9242849413ea tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:41.029604 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-0976eb69-f816-4ec0-8880-9242849413ea tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:41.035719 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0976eb69-f816-4ec0-8880-9242849413ea tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:41.036170 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0976eb69-f816-4ec0-8880-9242849413ea tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:41.036986 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0976eb69-f816-4ec0-8880-9242849413ea tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:41.037422 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0976eb69-f816-4ec0-8880-9242849413ea tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:41.147550 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-0976eb69-f816-4ec0-8880-9242849413ea tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.120348 May 23 16:46:41.147550 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 105/199] 10.222.0.74 () {58 vars in 1274 bytes} [Mon May 23 16:46:41 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:46:41.291182 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7c5a8ed1-dafc-47ab-9b23-d455fa492205 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:41.300136 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-7c5a8ed1-dafc-47ab-9b23-d455fa492205 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1553 microversion: 2.1 time: 0.307886 May 23 16:46:41.300908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 95/200] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:40 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1553 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:42.030864 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-cf929893-b380-428e-8dba-98ed6c2dd400 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:42.032182 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-cf929893-b380-428e-8dba-98ed6c2dd400 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:42.038603 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cf929893-b380-428e-8dba-98ed6c2dd400 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:42.039263 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cf929893-b380-428e-8dba-98ed6c2dd400 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:42.040263 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cf929893-b380-428e-8dba-98ed6c2dd400 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:42.041418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cf929893-b380-428e-8dba-98ed6c2dd400 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:42.245662 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-cf929893-b380-428e-8dba-98ed6c2dd400 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:42.262352 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-cf929893-b380-428e-8dba-98ed6c2dd400 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.235219 May 23 16:46:42.272704 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 106/201] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:42 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:42.319727 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-c0bb6e1e-0aa0-4546-85bd-bb5680188fa7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:42.320690 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-c0bb6e1e-0aa0-4546-85bd-bb5680188fa7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:42.333996 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c0bb6e1e-0aa0-4546-85bd-bb5680188fa7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:42.336038 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c0bb6e1e-0aa0-4546-85bd-bb5680188fa7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:42.338419 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c0bb6e1e-0aa0-4546-85bd-bb5680188fa7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:42.347832 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c0bb6e1e-0aa0-4546-85bd-bb5680188fa7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:42.354914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-ce8af429-aac3-41f9-b82b-1f5db5770fd0 req-343c6f14-f51d-48d1-83ae-7ad813f5365b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "405bb8d2-37bb-47fc-9ea9-c432cc0bafd4", "tag": "d9215691-0275-40e1-bf02-9d9be4c9e0e9"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:46:42.363718 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-ce8af429-aac3-41f9-b82b-1f5db5770fd0 req-343c6f14-f51d-48d1-83ae-7ad813f5365b service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:42.364377 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-ce8af429-aac3-41f9-b82b-1f5db5770fd0 req-343c6f14-f51d-48d1-83ae-7ad813f5365b service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:42.377082 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-ce8af429-aac3-41f9-b82b-1f5db5770fd0 req-343c6f14-f51d-48d1-83ae-7ad813f5365b service nova] Creating event network-changed:d9215691-0275-40e1-bf02-9d9be4c9e0e9 for instance 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 on hv-cinder-83925 May 23 16:46:42.382855 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-ce8af429-aac3-41f9-b82b-1f5db5770fd0 req-343c6f14-f51d-48d1-83ae-7ad813f5365b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031932 May 23 16:46:42.392511 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 107/202] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:46:42.479849 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-c0bb6e1e-0aa0-4546-85bd-bb5680188fa7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:42.493602 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-c0bb6e1e-0aa0-4546-85bd-bb5680188fa7 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1511 microversion: 2.1 time: 0.177567 May 23 16:46:42.501440 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 96/203] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:42 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1511 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:42.516556 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-d641bb74-e753-499c-9fc2-7b1c1a87abb3 req-2950239c-3fb0-4171-9ae3-ff06b0598144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c9f1fc3-3479-44e4-bdbc-702eef9f3920", "name": "network-vif-deleted", "tag": "e29253f1-4195-40c3-8e0d-2f6697fb6de0"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:46:42.527689 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-d641bb74-e753-499c-9fc2-7b1c1a87abb3 req-2950239c-3fb0-4171-9ae3-ff06b0598144 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:42.528129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-d641bb74-e753-499c-9fc2-7b1c1a87abb3 req-2950239c-3fb0-4171-9ae3-ff06b0598144 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:42.551848 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-d641bb74-e753-499c-9fc2-7b1c1a87abb3 req-2950239c-3fb0-4171-9ae3-ff06b0598144 service nova] Creating event network-vif-deleted:e29253f1-4195-40c3-8e0d-2f6697fb6de0 for instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 on hv-cinder-83925 May 23 16:46:42.561188 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-d641bb74-e753-499c-9fc2-7b1c1a87abb3 req-2950239c-3fb0-4171-9ae3-ff06b0598144 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051096 May 23 16:46:42.561941 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 108/204] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:46:43.279677 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-c5ef0545-09ea-425f-bb50-31557fa969c6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:43.280566 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-c5ef0545-09ea-425f-bb50-31557fa969c6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:43.288022 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c5ef0545-09ea-425f-bb50-31557fa969c6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:43.288687 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c5ef0545-09ea-425f-bb50-31557fa969c6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:43.295160 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c5ef0545-09ea-425f-bb50-31557fa969c6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:43.295160 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c5ef0545-09ea-425f-bb50-31557fa969c6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:43.449027 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-c5ef0545-09ea-425f-bb50-31557fa969c6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:43.457795 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-c5ef0545-09ea-425f-bb50-31557fa969c6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.182378 May 23 16:46:43.458476 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 97/205] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:43 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:43.512847 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a88dcf32-ee97-4a61-9f2e-0d134d20723b tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:43.514292 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a88dcf32-ee97-4a61-9f2e-0d134d20723b tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:43.520693 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a88dcf32-ee97-4a61-9f2e-0d134d20723b tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:43.521359 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a88dcf32-ee97-4a61-9f2e-0d134d20723b tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:43.522712 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a88dcf32-ee97-4a61-9f2e-0d134d20723b tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:43.523546 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a88dcf32-ee97-4a61-9f2e-0d134d20723b tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:43.561075 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a88dcf32-ee97-4a61-9f2e-0d134d20723b tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:43.561239 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a88dcf32-ee97-4a61-9f2e-0d134d20723b tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:43.561696 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.objects.instance [None req-a88dcf32-ee97-4a61-9f2e-0d134d20723b tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lazy-loading 'fault' on Instance uuid 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 {{(pid=124715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:46:43.629500 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a88dcf32-ee97-4a61-9f2e-0d134d20723b tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7100e6b15442e895c72cb41116e76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5c77313d114be8a334b6009147d627', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:43.648953 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a88dcf32-ee97-4a61-9f2e-0d134d20723b tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 200 len: 1350 microversion: 2.1 time: 0.141201 May 23 16:46:43.651927 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 109/206] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:43 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 1350 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:44.475449 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-17673041-8607-412e-a8ea-2d06ef762a8e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:44.476039 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-17673041-8607-412e-a8ea-2d06ef762a8e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:44.483255 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-17673041-8607-412e-a8ea-2d06ef762a8e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:44.483760 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-17673041-8607-412e-a8ea-2d06ef762a8e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:44.484566 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-17673041-8607-412e-a8ea-2d06ef762a8e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:44.485077 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-17673041-8607-412e-a8ea-2d06ef762a8e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:44.627151 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-17673041-8607-412e-a8ea-2d06ef762a8e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:44.635735 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-17673041-8607-412e-a8ea-2d06ef762a8e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.163429 May 23 16:46:44.636333 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 98/207] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:44 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:44.669795 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-8900302c-9fa7-4bcf-8b5d-46c907af8d72 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:44.670420 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-8900302c-9fa7-4bcf-8b5d-46c907af8d72 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:44.676907 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8900302c-9fa7-4bcf-8b5d-46c907af8d72 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:44.679038 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8900302c-9fa7-4bcf-8b5d-46c907af8d72 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:44.679038 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8900302c-9fa7-4bcf-8b5d-46c907af8d72 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:44.679038 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8900302c-9fa7-4bcf-8b5d-46c907af8d72 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:44.693597 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-8900302c-9fa7-4bcf-8b5d-46c907af8d72 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] HTTP exception thrown: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. May 23 16:46:44.699492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-8900302c-9fa7-4bcf-8b5d-46c907af8d72 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Request method failure captured: May 23 16:46:44.699492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 HTTP/1.1 May 23 16:46:44.699492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:46:44.699492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:46:44.699492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:46:44.699492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:46:44.699492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:46:44.699492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:46:44.699492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:46:44.699492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:46:44.699492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7opphdnwKioeagYt1YzZR7e2TaM4pkmqh23AyRFYBza9ItzJAzoIpGmQi_LHe39sNk07OXrGETH05Ar2X8D4lS6PxBkqEPEztqa3oxzxt4jawsP7QRu8sNYZM1mEt1YG17LMhw89I2EgQYh1k90j58pJ1gkigFxm05_PrPlCd0UPv8 May 23 16:46:44.699492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:46:44.699492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:46:44.699492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:46:44.699492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:46:44.699492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:46:44.699492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:46:44.699492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: fc5c77313d114be8a334b6009147d627 May 23 16:46:44.699492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-DeleteServersTestJSON-19008316 May 23 16:46:44.699492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:46:44.699492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:46:44.709165 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/fc5c77313d114be8a334b6009147d627"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/fc5c77313d114be8a334b6009147d627"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/fc5c77313d114be8a334b6009147d627"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_fc5c77313d114be8a334b6009147d627"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:46:44.709165 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-DeleteServersTestJSON-19008316 May 23 16:46:44.709165 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: fc5c77313d114be8a334b6009147d627 May 23 16:46:44.709165 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-DeleteServersTestJSON-19008316 May 23 16:46:44.709165 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-DeleteServersTestJSON-19008316-project May 23 16:46:44.709165 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:46:44.709165 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:46:44.709165 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: 8d7100e6b15442e895c72cb41116e76b May 23 16:46:44.709165 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-DeleteServersTestJSON-19008316-project May 23 16:46:44.709165 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 16:46:44.709165 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. May 23 16:46:44.709165 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': '6c9f1fc3-3479-44e4-bdbc-702eef9f3920'} May 23 16:46:44.710444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:46:44.710444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:46:44.710444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:46:44.710444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:46:44.710444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:46:44.710444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:46:44.710444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:46:44.710444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:46:44.710444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:46:44.710444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:46:44.710444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. May 23 16:46:44.710444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:46:44.710444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:46:44.710444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:46:44.710444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:46:44.710444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:46:44.710444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:46:44.710444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:46:44.710444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:46:44.710444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:46:44.711914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:46:44.711914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:46:44.711914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:46:44.711914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:46:44.711914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:46:44.711914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:46:44.711914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:46:44.711914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. May 23 16:46:44.711914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:46:44.711914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:46:44.711914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:46:44.711914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:46:44.711914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:46:44.711914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:46:44.711914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:46:44.711914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:46:44.711914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. May 23 16:46:44.711914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:46:44.714108 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-8900302c-9fa7-4bcf-8b5d-46c907af8d72 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Returning 404 to user: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:46:44.714108 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-8900302c-9fa7-4bcf-8b5d-46c907af8d72 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 404 len: 111 microversion: 2.1 time: 0.036240 May 23 16:46:44.714108 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 110/208] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:44 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:46:44.834922 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ccbc85ff-7ac8-46cd-b9ba-52da59401b76 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:44.836203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ccbc85ff-7ac8-46cd-b9ba-52da59401b76 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:44.843056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ccbc85ff-7ac8-46cd-b9ba-52da59401b76 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:44.843941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ccbc85ff-7ac8-46cd-b9ba-52da59401b76 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:44.844280 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ccbc85ff-7ac8-46cd-b9ba-52da59401b76 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:44.844756 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ccbc85ff-7ac8-46cd-b9ba-52da59401b76 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:44.858071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-ccbc85ff-7ac8-46cd-b9ba-52da59401b76 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] HTTP exception thrown: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. May 23 16:46:44.862194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ccbc85ff-7ac8-46cd-b9ba-52da59401b76 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Request method failure captured: May 23 16:46:44.862194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920/os-volume_attachments HTTP/1.1 May 23 16:46:44.862194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:46:44.862194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:46:44.862194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:46:44.862194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 16:46:44.862194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:46:44.862194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:46:44.862194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:46:44.862194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:46:44.862194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7opphdnwKioeagYt1YzZR7e2TaM4pkmqh23AyRFYBza9ItzJAzoIpGmQi_LHe39sNk07OXrGETH05Ar2X8D4lS6PxBkqEPEztqa3oxzxt4jawsP7QRu8sNYZM1mEt1YG17LMhw89I2EgQYh1k90j58pJ1gkigFxm05_PrPlCd0UPv8 May 23 16:46:44.862194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:46:44.862194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:46:44.862194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:46:44.862194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:46:44.862194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:46:44.862194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:46:44.862194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: fc5c77313d114be8a334b6009147d627 May 23 16:46:44.862194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-DeleteServersTestJSON-19008316 May 23 16:46:44.862194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:46:44.862194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:46:44.863439 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/fc5c77313d114be8a334b6009147d627"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/fc5c77313d114be8a334b6009147d627"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/fc5c77313d114be8a334b6009147d627"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_fc5c77313d114be8a334b6009147d627"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:46:44.863439 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-DeleteServersTestJSON-19008316 May 23 16:46:44.863439 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: fc5c77313d114be8a334b6009147d627 May 23 16:46:44.863439 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-DeleteServersTestJSON-19008316 May 23 16:46:44.863439 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-DeleteServersTestJSON-19008316-project May 23 16:46:44.863439 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:46:44.863439 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:46:44.863439 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 8d7100e6b15442e895c72cb41116e76b May 23 16:46:44.863439 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-DeleteServersTestJSON-19008316-project May 23 16:46:44.863439 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: > May 23 16:46:44.863439 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. May 23 16:46:44.863439 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'server_id': '6c9f1fc3-3479-44e4-bdbc-702eef9f3920'} May 23 16:46:44.864093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:46:44.864093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:46:44.864093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:46:44.864093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:46:44.864093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:46:44.864093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:46:44.864093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:46:44.864093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:46:44.864093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:46:44.864093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:46:44.864093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. May 23 16:46:44.864093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:46:44.864093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:46:44.864093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:46:44.864093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:46:44.864093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:46:44.864093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:46:44.864093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:46:44.864093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:46:44.864093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:46:44.868753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:46:44.868753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 23 16:46:44.868753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 16:46:44.868753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 23 16:46:44.868753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 16:46:44.868753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 23 16:46:44.868753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 23 16:46:44.868753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:46:44.868753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:46:44.868753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. May 23 16:46:44.868753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:46:44.868753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:46:44.868753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:46:44.868753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:46:44.868753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:46:44.868753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:46:44.868753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:46:44.868753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:46:44.868753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. May 23 16:46:44.868753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:46:44.870154 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ccbc85ff-7ac8-46cd-b9ba-52da59401b76 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Returning 404 to user: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:46:44.870154 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ccbc85ff-7ac8-46cd-b9ba-52da59401b76 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032691 May 23 16:46:44.870154 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 99/209] 10.222.0.74 () {58 vars in 1301 bytes} [Mon May 23 16:46:44 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:46:45.654075 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-69a6ea79-26d6-4b0e-919e-94ae4782fcea tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:45.655661 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-69a6ea79-26d6-4b0e-919e-94ae4782fcea tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:45.661852 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-69a6ea79-26d6-4b0e-919e-94ae4782fcea tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:45.662270 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-69a6ea79-26d6-4b0e-919e-94ae4782fcea tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:45.663043 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-69a6ea79-26d6-4b0e-919e-94ae4782fcea tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:45.663496 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-69a6ea79-26d6-4b0e-919e-94ae4782fcea tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:45.795586 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-69a6ea79-26d6-4b0e-919e-94ae4782fcea tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:45.803056 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-69a6ea79-26d6-4b0e-919e-94ae4782fcea tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.153568 May 23 16:46:45.803618 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 111/210] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:45 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:46.226329 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-c5046e30-ac70-4db9-bcc2-c383b65c3a29 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:46.226840 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-c5046e30-ac70-4db9-bcc2-c383b65c3a29 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:46.235221 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c5046e30-ac70-4db9-bcc2-c383b65c3a29 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:46.235678 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c5046e30-ac70-4db9-bcc2-c383b65c3a29 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:46.236484 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c5046e30-ac70-4db9-bcc2-c383b65c3a29 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:46.237089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c5046e30-ac70-4db9-bcc2-c383b65c3a29 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:46.256495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-c5046e30-ac70-4db9-bcc2-c383b65c3a29 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] HTTP exception thrown: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. May 23 16:46:46.259394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-c5046e30-ac70-4db9-bcc2-c383b65c3a29 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Request method failure captured: May 23 16:46:46.259394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: DELETE /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 HTTP/1.1 May 23 16:46:46.259394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:46:46.259394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:46:46.259394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:46:46.259394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 16:46:46.259394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:46:46.259394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:46:46.259394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:46:46.259394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:46:46.259394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7opphdnwKioeagYt1YzZR7e2TaM4pkmqh23AyRFYBza9ItzJAzoIpGmQi_LHe39sNk07OXrGETH05Ar2X8D4lS6PxBkqEPEztqa3oxzxt4jawsP7QRu8sNYZM1mEt1YG17LMhw89I2EgQYh1k90j58pJ1gkigFxm05_PrPlCd0UPv8 May 23 16:46:46.259394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:46:46.259394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:46:46.259394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:46:46.259394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:46:46.259394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:46:46.259394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:46:46.259394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: fc5c77313d114be8a334b6009147d627 May 23 16:46:46.259394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-DeleteServersTestJSON-19008316 May 23 16:46:46.259394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:46:46.259394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:46:46.261869 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/fc5c77313d114be8a334b6009147d627"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/fc5c77313d114be8a334b6009147d627"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/fc5c77313d114be8a334b6009147d627"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_fc5c77313d114be8a334b6009147d627"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:46:46.261869 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-DeleteServersTestJSON-19008316 May 23 16:46:46.261869 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: fc5c77313d114be8a334b6009147d627 May 23 16:46:46.261869 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-DeleteServersTestJSON-19008316 May 23 16:46:46.261869 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-DeleteServersTestJSON-19008316-project May 23 16:46:46.261869 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:46:46.261869 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:46:46.261869 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 8d7100e6b15442e895c72cb41116e76b May 23 16:46:46.261869 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-DeleteServersTestJSON-19008316-project May 23 16:46:46.261869 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: > May 23 16:46:46.261869 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. May 23 16:46:46.261869 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': '6c9f1fc3-3479-44e4-bdbc-702eef9f3920'} May 23 16:46:46.262550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:46:46.262550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:46:46.262550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:46:46.262550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:46:46.262550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:46:46.262550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:46:46.262550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:46:46.262550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:46:46.262550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:46:46.262550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:46:46.262550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. May 23 16:46:46.262550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:46:46.262550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:46:46.262550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:46:46.262550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:46:46.262550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:46:46.262550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:46:46.262550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:46:46.262550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:46:46.262550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:46:46.263642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:46:46.263642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 16:46:46.263642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 16:46:46.263642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 16:46:46.263642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 16:46:46.263642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:46:46.263642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:46:46.263642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:46:46.263642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:46:46.263642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. May 23 16:46:46.263642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:46:46.263642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:46:46.263642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:46:46.263642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:46:46.263642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:46:46.263642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:46:46.263642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:46:46.263642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:46:46.263642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. May 23 16:46:46.263642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:46:46.266337 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-c5046e30-ac70-4db9-bcc2-c383b65c3a29 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Returning 404 to user: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:46:46.267501 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-c5046e30-ac70-4db9-bcc2-c383b65c3a29 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "DELETE /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 404 len: 111 microversion: 2.1 time: 0.045290 May 23 16:46:46.268184 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 100/211] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 16:46:46 2022] DELETE /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:46:46.285377 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-5e825407-85d3-44bf-b74a-92ab2294b473 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:46.285377 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-5e825407-85d3-44bf-b74a-92ab2294b473 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] [instance: 6c9f1fc3-3479-44e4-bdbc-702eef9f3920] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:46.286859 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5e825407-85d3-44bf-b74a-92ab2294b473 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:46.287329 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5e825407-85d3-44bf-b74a-92ab2294b473 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:46.288119 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5e825407-85d3-44bf-b74a-92ab2294b473 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:46.288591 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5e825407-85d3-44bf-b74a-92ab2294b473 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:46.302919 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-5e825407-85d3-44bf-b74a-92ab2294b473 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] HTTP exception thrown: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. May 23 16:46:46.304544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-5e825407-85d3-44bf-b74a-92ab2294b473 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Request method failure captured: May 23 16:46:46.304544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 HTTP/1.1 May 23 16:46:46.304544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:46:46.304544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:46:46.304544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:46:46.304544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:46:46.304544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:46:46.304544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:46:46.304544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:46:46.304544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:46:46.304544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7opphdnwKioeagYt1YzZR7e2TaM4pkmqh23AyRFYBza9ItzJAzoIpGmQi_LHe39sNk07OXrGETH05Ar2X8D4lS6PxBkqEPEztqa3oxzxt4jawsP7QRu8sNYZM1mEt1YG17LMhw89I2EgQYh1k90j58pJ1gkigFxm05_PrPlCd0UPv8 May 23 16:46:46.304544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:46:46.304544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:46:46.304544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:46:46.304544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:46:46.304544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:46:46.304544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:46:46.304544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: fc5c77313d114be8a334b6009147d627 May 23 16:46:46.304544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-DeleteServersTestJSON-19008316 May 23 16:46:46.304544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:46:46.304544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:46:46.305802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/fc5c77313d114be8a334b6009147d627"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/fc5c77313d114be8a334b6009147d627"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/fc5c77313d114be8a334b6009147d627"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_fc5c77313d114be8a334b6009147d627"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:46:46.305802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-DeleteServersTestJSON-19008316 May 23 16:46:46.305802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: fc5c77313d114be8a334b6009147d627 May 23 16:46:46.305802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-DeleteServersTestJSON-19008316 May 23 16:46:46.305802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-DeleteServersTestJSON-19008316-project May 23 16:46:46.305802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:46:46.305802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:46:46.305802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: 8d7100e6b15442e895c72cb41116e76b May 23 16:46:46.305802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-DeleteServersTestJSON-19008316-project May 23 16:46:46.305802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 16:46:46.305802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. May 23 16:46:46.305802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': '6c9f1fc3-3479-44e4-bdbc-702eef9f3920'} May 23 16:46:46.306514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:46:46.306514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:46:46.306514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:46:46.306514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:46:46.306514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:46:46.306514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:46:46.306514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:46:46.306514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:46:46.306514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:46:46.306514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:46:46.306514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. May 23 16:46:46.306514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:46:46.306514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:46:46.306514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:46:46.306514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:46:46.306514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:46:46.306514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:46:46.306514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:46:46.306514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:46:46.306514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:46:46.308217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:46:46.308217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:46:46.308217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:46:46.308217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:46:46.308217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:46:46.308217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:46:46.308217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:46:46.308217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. May 23 16:46:46.308217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:46:46.308217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:46:46.308217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:46:46.308217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:46:46.308217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:46:46.308217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:46:46.308217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:46:46.308217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:46:46.308217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. May 23 16:46:46.308217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:46:46.310178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-5e825407-85d3-44bf-b74a-92ab2294b473 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] Returning 404 to user: Instance 6c9f1fc3-3479-44e4-bdbc-702eef9f3920 could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:46:46.310178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-5e825407-85d3-44bf-b74a-92ab2294b473 tempest-DeleteServersTestJSON-19008316 tempest-DeleteServersTestJSON-19008316-project] 10.222.0.74 "GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920" status: 404 len: 111 microversion: 2.1 time: 0.033486 May 23 16:46:46.310178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 112/212] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:46 2022] GET /compute/v2.1/servers/6c9f1fc3-3479-44e4-bdbc-702eef9f3920 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 16:46:46.821167 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-7bc2a2f1-ab86-4def-9c10-d0ad3a6c46d5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:46.821780 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-7bc2a2f1-ab86-4def-9c10-d0ad3a6c46d5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:46.828263 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7bc2a2f1-ab86-4def-9c10-d0ad3a6c46d5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:46.828743 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7bc2a2f1-ab86-4def-9c10-d0ad3a6c46d5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:46.829505 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7bc2a2f1-ab86-4def-9c10-d0ad3a6c46d5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:46.829941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7bc2a2f1-ab86-4def-9c10-d0ad3a6c46d5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:47.031143 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7bc2a2f1-ab86-4def-9c10-d0ad3a6c46d5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:47.041194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-7bc2a2f1-ab86-4def-9c10-d0ad3a6c46d5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.223894 May 23 16:46:47.042861 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 101/213] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:46 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:48.060175 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7936bddd-3247-47ab-8bae-7c96e9daad28 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:48.060994 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-7936bddd-3247-47ab-8bae-7c96e9daad28 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:48.064125 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:48.082781 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7936bddd-3247-47ab-8bae-7c96e9daad28 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:48.083277 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7936bddd-3247-47ab-8bae-7c96e9daad28 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:48.084071 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7936bddd-3247-47ab-8bae-7c96e9daad28 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:48.086237 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7936bddd-3247-47ab-8bae-7c96e9daad28 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:48.248699 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-7936bddd-3247-47ab-8bae-7c96e9daad28 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:48.258046 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-7936bddd-3247-47ab-8bae-7c96e9daad28 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.202956 May 23 16:46:48.258739 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 113/214] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:48 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:49.277211 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-132ded78-805c-40dd-be9d-4db421758121 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:49.277853 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-132ded78-805c-40dd-be9d-4db421758121 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:49.285397 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-132ded78-805c-40dd-be9d-4db421758121 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:49.285928 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-132ded78-805c-40dd-be9d-4db421758121 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:49.286842 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-132ded78-805c-40dd-be9d-4db421758121 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:49.287493 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-132ded78-805c-40dd-be9d-4db421758121 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:49.444639 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-132ded78-805c-40dd-be9d-4db421758121 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:49.453199 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-132ded78-805c-40dd-be9d-4db421758121 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.181240 May 23 16:46:49.453785 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 102/215] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:49 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:50.470072 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-933c0205-0c7a-4f0e-ad3b-5b6cae37a9b9 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:50.470682 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-933c0205-0c7a-4f0e-ad3b-5b6cae37a9b9 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:50.477960 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-933c0205-0c7a-4f0e-ad3b-5b6cae37a9b9 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:50.478482 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-933c0205-0c7a-4f0e-ad3b-5b6cae37a9b9 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:50.480040 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-933c0205-0c7a-4f0e-ad3b-5b6cae37a9b9 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:50.480709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-933c0205-0c7a-4f0e-ad3b-5b6cae37a9b9 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:50.626914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-933c0205-0c7a-4f0e-ad3b-5b6cae37a9b9 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:50.634598 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-933c0205-0c7a-4f0e-ad3b-5b6cae37a9b9 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.168190 May 23 16:46:50.636003 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 114/216] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:50 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:51.655659 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-cec9a612-11bb-41a0-b32a-cbe445d17149 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:51.656555 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-cec9a612-11bb-41a0-b32a-cbe445d17149 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:51.665138 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cec9a612-11bb-41a0-b32a-cbe445d17149 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:51.666432 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cec9a612-11bb-41a0-b32a-cbe445d17149 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:51.667834 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cec9a612-11bb-41a0-b32a-cbe445d17149 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:51.668842 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cec9a612-11bb-41a0-b32a-cbe445d17149 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:51.824925 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-cec9a612-11bb-41a0-b32a-cbe445d17149 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:51.833114 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-cec9a612-11bb-41a0-b32a-cbe445d17149 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.184383 May 23 16:46:51.833770 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 103/217] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:51 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:52.850433 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-76359c5e-3693-42e3-a9a2-12979f6ada54 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:52.851043 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-76359c5e-3693-42e3-a9a2-12979f6ada54 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:52.857778 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-76359c5e-3693-42e3-a9a2-12979f6ada54 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:52.858252 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-76359c5e-3693-42e3-a9a2-12979f6ada54 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:52.859007 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-76359c5e-3693-42e3-a9a2-12979f6ada54 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:52.859441 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-76359c5e-3693-42e3-a9a2-12979f6ada54 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:53.041108 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-76359c5e-3693-42e3-a9a2-12979f6ada54 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:53.054941 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-76359c5e-3693-42e3-a9a2-12979f6ada54 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.207960 May 23 16:46:53.067197 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 115/218] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:52 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:54.074489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-1b7b6a62-561d-444d-9a23-144e26c43493 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:54.076283 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-1b7b6a62-561d-444d-9a23-144e26c43493 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:54.078480 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=65 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:54.089700 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1b7b6a62-561d-444d-9a23-144e26c43493 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:54.090281 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1b7b6a62-561d-444d-9a23-144e26c43493 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:54.091064 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1b7b6a62-561d-444d-9a23-144e26c43493 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:54.119037 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1b7b6a62-561d-444d-9a23-144e26c43493 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:54.304144 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-1b7b6a62-561d-444d-9a23-144e26c43493 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:54.312339 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-1b7b6a62-561d-444d-9a23-144e26c43493 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.242907 May 23 16:46:54.313523 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 104/219] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:54 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:55.329172 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-1e7b6f27-b0bb-48ac-9e24-424231feb260 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:55.330399 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-1e7b6f27-b0bb-48ac-9e24-424231feb260 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:55.340532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1e7b6f27-b0bb-48ac-9e24-424231feb260 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:55.340532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1e7b6f27-b0bb-48ac-9e24-424231feb260 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:55.340532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1e7b6f27-b0bb-48ac-9e24-424231feb260 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:55.340532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1e7b6f27-b0bb-48ac-9e24-424231feb260 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:55.341754 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:46:55.490286 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-1e7b6f27-b0bb-48ac-9e24-424231feb260 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:55.498114 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-1e7b6f27-b0bb-48ac-9e24-424231feb260 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.172997 May 23 16:46:55.498558 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 116/220] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:55 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:56.515640 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-0d4e7e45-c764-4cbb-80e1-a91fc92f0481 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:56.516253 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-0d4e7e45-c764-4cbb-80e1-a91fc92f0481 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:56.525515 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0d4e7e45-c764-4cbb-80e1-a91fc92f0481 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:56.538081 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0d4e7e45-c764-4cbb-80e1-a91fc92f0481 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:56.538081 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0d4e7e45-c764-4cbb-80e1-a91fc92f0481 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:56.538081 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0d4e7e45-c764-4cbb-80e1-a91fc92f0481 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:56.657696 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-0d4e7e45-c764-4cbb-80e1-a91fc92f0481 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:56.665826 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-0d4e7e45-c764-4cbb-80e1-a91fc92f0481 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.154003 May 23 16:46:56.667186 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 105/221] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:56 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:46:57.683555 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e8f664a7-f300-43f6-a8e6-26955e70b7f2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:57.684579 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e8f664a7-f300-43f6-a8e6-26955e70b7f2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:57.691684 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e8f664a7-f300-43f6-a8e6-26955e70b7f2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:57.692133 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e8f664a7-f300-43f6-a8e6-26955e70b7f2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:57.692929 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e8f664a7-f300-43f6-a8e6-26955e70b7f2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:57.693363 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e8f664a7-f300-43f6-a8e6-26955e70b7f2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:57.853824 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e8f664a7-f300-43f6-a8e6-26955e70b7f2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:57.861572 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e8f664a7-f300-43f6-a8e6-26955e70b7f2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.182394 May 23 16:46:57.862148 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 117/222] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:57 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:46:58.880019 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-b3a4a505-c418-45ff-994e-f1025b385462 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:46:58.880797 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-b3a4a505-c418-45ff-994e-f1025b385462 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:46:58.887798 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b3a4a505-c418-45ff-994e-f1025b385462 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:58.888243 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b3a4a505-c418-45ff-994e-f1025b385462 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:58.889126 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b3a4a505-c418-45ff-994e-f1025b385462 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:46:58.889596 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b3a4a505-c418-45ff-994e-f1025b385462 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:46:59.031675 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b3a4a505-c418-45ff-994e-f1025b385462 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:46:59.039389 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-b3a4a505-c418-45ff-994e-f1025b385462 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.163981 May 23 16:46:59.049074 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 106/223] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:46:58 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:00.057018 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-4af4881d-3a74-4cf1-9caa-1a95bfd5b630 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:00.058545 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-4af4881d-3a74-4cf1-9caa-1a95bfd5b630 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:00.068640 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4af4881d-3a74-4cf1-9caa-1a95bfd5b630 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:00.073260 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4af4881d-3a74-4cf1-9caa-1a95bfd5b630 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:00.073260 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4af4881d-3a74-4cf1-9caa-1a95bfd5b630 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:00.073260 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4af4881d-3a74-4cf1-9caa-1a95bfd5b630 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:00.238545 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-4af4881d-3a74-4cf1-9caa-1a95bfd5b630 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:00.247445 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-4af4881d-3a74-4cf1-9caa-1a95bfd5b630 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.194674 May 23 16:47:00.248090 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 118/224] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:00 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:01.268355 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-2d10c7e0-fc38-48a4-bb03-0cdb38ffa1eb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:01.268355 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-2d10c7e0-fc38-48a4-bb03-0cdb38ffa1eb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:01.279541 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2d10c7e0-fc38-48a4-bb03-0cdb38ffa1eb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:01.280007 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2d10c7e0-fc38-48a4-bb03-0cdb38ffa1eb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:01.281976 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2d10c7e0-fc38-48a4-bb03-0cdb38ffa1eb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:01.282420 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2d10c7e0-fc38-48a4-bb03-0cdb38ffa1eb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:01.418792 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-2d10c7e0-fc38-48a4-bb03-0cdb38ffa1eb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:01.426676 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-2d10c7e0-fc38-48a4-bb03-0cdb38ffa1eb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.165464 May 23 16:47:01.427235 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 107/225] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:01 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:02.446303 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-bc9614de-6f42-4fe2-85da-9f00028d2d36 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:02.449570 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-bc9614de-6f42-4fe2-85da-9f00028d2d36 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:02.458667 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bc9614de-6f42-4fe2-85da-9f00028d2d36 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:02.462548 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bc9614de-6f42-4fe2-85da-9f00028d2d36 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:02.463885 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bc9614de-6f42-4fe2-85da-9f00028d2d36 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:02.465125 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bc9614de-6f42-4fe2-85da-9f00028d2d36 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:02.655663 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-bc9614de-6f42-4fe2-85da-9f00028d2d36 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:02.663118 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-bc9614de-6f42-4fe2-85da-9f00028d2d36 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.223120 May 23 16:47:02.663703 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 119/226] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:02 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:03.681488 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-8a9f3a41-a64b-4495-87c1-037643f132b5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:03.695919 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-8a9f3a41-a64b-4495-87c1-037643f132b5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:03.706424 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8a9f3a41-a64b-4495-87c1-037643f132b5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:03.706883 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8a9f3a41-a64b-4495-87c1-037643f132b5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:03.707862 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8a9f3a41-a64b-4495-87c1-037643f132b5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:03.708337 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8a9f3a41-a64b-4495-87c1-037643f132b5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:03.849853 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8a9f3a41-a64b-4495-87c1-037643f132b5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:03.857649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-8a9f3a41-a64b-4495-87c1-037643f132b5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.180430 May 23 16:47:03.858813 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 108/227] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:03 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:04.874390 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-8960dba7-2b00-49fd-9dd1-03236a4d4c81 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:04.875272 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-8960dba7-2b00-49fd-9dd1-03236a4d4c81 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:04.881873 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8960dba7-2b00-49fd-9dd1-03236a4d4c81 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:04.882444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8960dba7-2b00-49fd-9dd1-03236a4d4c81 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:04.883782 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8960dba7-2b00-49fd-9dd1-03236a4d4c81 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:04.884545 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8960dba7-2b00-49fd-9dd1-03236a4d4c81 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:05.038983 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-8960dba7-2b00-49fd-9dd1-03236a4d4c81 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:05.049138 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-8960dba7-2b00-49fd-9dd1-03236a4d4c81 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.178970 May 23 16:47:05.049730 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 120/228] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:04 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:06.070744 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-f4108382-7f85-46e1-aa36-9208a8a9e290 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:06.070744 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-f4108382-7f85-46e1-aa36-9208a8a9e290 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:06.074700 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f4108382-7f85-46e1-aa36-9208a8a9e290 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:06.075224 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f4108382-7f85-46e1-aa36-9208a8a9e290 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:06.075934 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f4108382-7f85-46e1-aa36-9208a8a9e290 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:06.076452 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f4108382-7f85-46e1-aa36-9208a8a9e290 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:06.250161 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-f4108382-7f85-46e1-aa36-9208a8a9e290 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:06.257994 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-f4108382-7f85-46e1-aa36-9208a8a9e290 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1521 microversion: 2.1 time: 0.195560 May 23 16:47:06.258569 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 109/229] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:06 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:07.274944 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-cb3c7173-422f-4f48-ae2b-4a8b33671206 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:07.275643 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-cb3c7173-422f-4f48-ae2b-4a8b33671206 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:07.282527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cb3c7173-422f-4f48-ae2b-4a8b33671206 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:07.282982 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cb3c7173-422f-4f48-ae2b-4a8b33671206 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:07.283779 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cb3c7173-422f-4f48-ae2b-4a8b33671206 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:07.284214 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cb3c7173-422f-4f48-ae2b-4a8b33671206 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:07.465060 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-cb3c7173-422f-4f48-ae2b-4a8b33671206 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:07.472533 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-cb3c7173-422f-4f48-ae2b-4a8b33671206 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1501 microversion: 2.1 time: 0.201401 May 23 16:47:07.473100 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 121/230] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:07 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1501 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:07.488429 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-db33b70b-5342-424e-baad-691930aa893f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:07.489047 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-db33b70b-5342-424e-baad-691930aa893f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:07.495612 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-db33b70b-5342-424e-baad-691930aa893f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:07.496143 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-db33b70b-5342-424e-baad-691930aa893f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:07.496974 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-db33b70b-5342-424e-baad-691930aa893f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:07.497424 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-db33b70b-5342-424e-baad-691930aa893f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:07.500000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=100 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:07.648614 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-db33b70b-5342-424e-baad-691930aa893f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:07.668528 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-db33b70b-5342-424e-baad-691930aa893f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1515 microversion: 2.1 time: 0.171858 May 23 16:47:07.668528 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 110/231] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:07 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:10.516884 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-857321cc-c644-404c-bbd4-22d5e571a31d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:47:10.517835 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-857321cc-c644-404c-bbd4-22d5e571a31d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:10.526251 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-857321cc-c644-404c-bbd4-22d5e571a31d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:10.527516 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-857321cc-c644-404c-bbd4-22d5e571a31d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:10.528364 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-857321cc-c644-404c-bbd4-22d5e571a31d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:10.529106 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-857321cc-c644-404c-bbd4-22d5e571a31d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:10.552328 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.objects.instance [None req-857321cc-c644-404c-bbd4-22d5e571a31d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lazy-loading 'flavor' on Instance uuid 2ff57504-04ce-414c-b676-fb6bcec4cccf {{(pid=124715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:47:10.796029 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-857321cc-c644-404c-bbd4-22d5e571a31d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "POST /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf/action" status: 200 len: 32 microversion: 2.1 time: 0.283011 May 23 16:47:10.796603 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 122/232] 10.222.0.74 () {60 vars in 1277 bytes} [Mon May 23 16:47:10 2022] POST /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf/action => generated 32 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 16:47:10.806899 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-25a9e209-a847-42ba-bb76-e53e6c17a68b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:10.807519 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-25a9e209-a847-42ba-bb76-e53e6c17a68b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:10.815374 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-25a9e209-a847-42ba-bb76-e53e6c17a68b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:10.815843 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-25a9e209-a847-42ba-bb76-e53e6c17a68b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:10.816736 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-25a9e209-a847-42ba-bb76-e53e6c17a68b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:10.817330 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-25a9e209-a847-42ba-bb76-e53e6c17a68b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:10.953440 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-25a9e209-a847-42ba-bb76-e53e6c17a68b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:10.960869 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-25a9e209-a847-42ba-bb76-e53e6c17a68b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.158393 May 23 16:47:10.961436 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 111/233] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:10 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:11.981079 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-cb76d9a3-0269-4372-8e21-68b96aed1b06 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:11.981770 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-cb76d9a3-0269-4372-8e21-68b96aed1b06 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:11.987870 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cb76d9a3-0269-4372-8e21-68b96aed1b06 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:11.988339 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cb76d9a3-0269-4372-8e21-68b96aed1b06 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:11.989095 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cb76d9a3-0269-4372-8e21-68b96aed1b06 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:11.989527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cb76d9a3-0269-4372-8e21-68b96aed1b06 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:12.116902 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-cb76d9a3-0269-4372-8e21-68b96aed1b06 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:12.124281 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-cb76d9a3-0269-4372-8e21-68b96aed1b06 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.148044 May 23 16:47:12.124865 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 123/234] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:11 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:13.141779 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-e4767101-43e7-4542-be0d-b9c431245b3c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:13.142414 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-e4767101-43e7-4542-be0d-b9c431245b3c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:13.148853 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e4767101-43e7-4542-be0d-b9c431245b3c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:13.149301 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e4767101-43e7-4542-be0d-b9c431245b3c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:13.150051 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e4767101-43e7-4542-be0d-b9c431245b3c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:13.150482 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e4767101-43e7-4542-be0d-b9c431245b3c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:13.285907 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e4767101-43e7-4542-be0d-b9c431245b3c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:13.294421 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-e4767101-43e7-4542-be0d-b9c431245b3c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.156453 May 23 16:47:13.294999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 112/235] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:13 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:14.311890 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-2ff30848-d7cc-45c0-a38a-aba52d911d0f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:14.312744 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-2ff30848-d7cc-45c0-a38a-aba52d911d0f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:14.319015 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2ff30848-d7cc-45c0-a38a-aba52d911d0f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:14.319465 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2ff30848-d7cc-45c0-a38a-aba52d911d0f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:14.320270 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2ff30848-d7cc-45c0-a38a-aba52d911d0f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:14.320736 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2ff30848-d7cc-45c0-a38a-aba52d911d0f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:14.457665 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-2ff30848-d7cc-45c0-a38a-aba52d911d0f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:14.465120 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-2ff30848-d7cc-45c0-a38a-aba52d911d0f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.158146 May 23 16:47:14.466211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 124/236] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:14 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:15.482661 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-9dd70a04-d997-4558-a8d7-f1c8619822c2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:15.483269 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-9dd70a04-d997-4558-a8d7-f1c8619822c2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:15.494472 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9dd70a04-d997-4558-a8d7-f1c8619822c2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:15.494472 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9dd70a04-d997-4558-a8d7-f1c8619822c2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:15.494472 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9dd70a04-d997-4558-a8d7-f1c8619822c2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:15.494472 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9dd70a04-d997-4558-a8d7-f1c8619822c2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:15.625348 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-9dd70a04-d997-4558-a8d7-f1c8619822c2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:15.632917 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-9dd70a04-d997-4558-a8d7-f1c8619822c2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.154062 May 23 16:47:15.633577 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 113/237] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:15 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:16.649923 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a3383530-6848-407e-aabb-790060473698 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:16.650444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a3383530-6848-407e-aabb-790060473698 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:16.656802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a3383530-6848-407e-aabb-790060473698 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:16.657399 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a3383530-6848-407e-aabb-790060473698 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:16.658332 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a3383530-6848-407e-aabb-790060473698 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:16.658780 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a3383530-6848-407e-aabb-790060473698 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:16.796586 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a3383530-6848-407e-aabb-790060473698 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:16.804049 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a3383530-6848-407e-aabb-790060473698 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.158302 May 23 16:47:16.804658 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 125/238] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:16 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:17.821605 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-8ffb2958-14be-4798-9011-a80e27433147 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:17.822224 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-8ffb2958-14be-4798-9011-a80e27433147 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:17.829272 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8ffb2958-14be-4798-9011-a80e27433147 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:17.829661 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8ffb2958-14be-4798-9011-a80e27433147 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:17.830430 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8ffb2958-14be-4798-9011-a80e27433147 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:17.830872 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8ffb2958-14be-4798-9011-a80e27433147 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:17.956983 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8ffb2958-14be-4798-9011-a80e27433147 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:17.964462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-8ffb2958-14be-4798-9011-a80e27433147 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.146781 May 23 16:47:17.973866 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 114/239] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:17 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:18.982334 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-1907e776-a69f-42aa-af93-6b2cca04c594 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:18.982991 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-1907e776-a69f-42aa-af93-6b2cca04c594 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:18.989036 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1907e776-a69f-42aa-af93-6b2cca04c594 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:18.989486 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1907e776-a69f-42aa-af93-6b2cca04c594 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:18.990249 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1907e776-a69f-42aa-af93-6b2cca04c594 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:18.990691 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1907e776-a69f-42aa-af93-6b2cca04c594 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:19.118456 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-1907e776-a69f-42aa-af93-6b2cca04c594 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:19.126429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-1907e776-a69f-42aa-af93-6b2cca04c594 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.148717 May 23 16:47:19.126988 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 126/240] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:18 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:20.143522 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-3f1fd8d7-e629-4026-99c1-722b8b1e34bc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:20.144143 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-3f1fd8d7-e629-4026-99c1-722b8b1e34bc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:20.150659 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3f1fd8d7-e629-4026-99c1-722b8b1e34bc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:20.151053 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3f1fd8d7-e629-4026-99c1-722b8b1e34bc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:20.151814 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3f1fd8d7-e629-4026-99c1-722b8b1e34bc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:20.152249 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3f1fd8d7-e629-4026-99c1-722b8b1e34bc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:20.288044 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-3f1fd8d7-e629-4026-99c1-722b8b1e34bc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:20.295482 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-3f1fd8d7-e629-4026-99c1-722b8b1e34bc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.155952 May 23 16:47:20.296042 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 115/241] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:20 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:21.312133 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-5490254b-5be0-460c-bcf2-f8a7907664b8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:21.312795 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-5490254b-5be0-460c-bcf2-f8a7907664b8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:21.318976 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5490254b-5be0-460c-bcf2-f8a7907664b8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:21.319424 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5490254b-5be0-460c-bcf2-f8a7907664b8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:21.323652 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5490254b-5be0-460c-bcf2-f8a7907664b8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:21.323652 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5490254b-5be0-460c-bcf2-f8a7907664b8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:21.454001 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-5490254b-5be0-460c-bcf2-f8a7907664b8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:21.462260 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-5490254b-5be0-460c-bcf2-f8a7907664b8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.154159 May 23 16:47:21.462835 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 127/242] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:21 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:22.480844 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-876f1bfd-4bea-46f6-9822-a6974941a0c6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:22.481341 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-876f1bfd-4bea-46f6-9822-a6974941a0c6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:22.487765 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-876f1bfd-4bea-46f6-9822-a6974941a0c6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:22.488210 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-876f1bfd-4bea-46f6-9822-a6974941a0c6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:22.489001 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-876f1bfd-4bea-46f6-9822-a6974941a0c6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:22.489431 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-876f1bfd-4bea-46f6-9822-a6974941a0c6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:22.616367 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-876f1bfd-4bea-46f6-9822-a6974941a0c6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:22.624443 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-876f1bfd-4bea-46f6-9822-a6974941a0c6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.147471 May 23 16:47:22.625008 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 116/243] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:22 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:23.641877 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-79d34743-8e24-474b-940e-22686489a5fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:23.642589 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-79d34743-8e24-474b-940e-22686489a5fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:23.644587 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=30 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:23.649248 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-79d34743-8e24-474b-940e-22686489a5fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:23.649692 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-79d34743-8e24-474b-940e-22686489a5fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:23.650446 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-79d34743-8e24-474b-940e-22686489a5fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:23.650879 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-79d34743-8e24-474b-940e-22686489a5fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:23.784548 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-79d34743-8e24-474b-940e-22686489a5fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:23.791847 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-79d34743-8e24-474b-940e-22686489a5fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.154377 May 23 16:47:23.792416 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 128/244] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:23 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:24.808039 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-0798724e-8458-46b4-8f1d-76dae0abfcab tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:24.808692 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-0798724e-8458-46b4-8f1d-76dae0abfcab tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:24.815275 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0798724e-8458-46b4-8f1d-76dae0abfcab tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:24.815733 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0798724e-8458-46b4-8f1d-76dae0abfcab tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:24.816536 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0798724e-8458-46b4-8f1d-76dae0abfcab tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:24.816981 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0798724e-8458-46b4-8f1d-76dae0abfcab tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:24.946042 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-0798724e-8458-46b4-8f1d-76dae0abfcab tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:24.953454 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-0798724e-8458-46b4-8f1d-76dae0abfcab tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.149394 May 23 16:47:24.954281 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 117/245] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:24 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:25.971119 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-d14e039f-02af-4b3c-b64f-1416635ef88d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:25.971738 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-d14e039f-02af-4b3c-b64f-1416635ef88d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:25.977762 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d14e039f-02af-4b3c-b64f-1416635ef88d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:25.978212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d14e039f-02af-4b3c-b64f-1416635ef88d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:25.978970 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d14e039f-02af-4b3c-b64f-1416635ef88d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:25.979407 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d14e039f-02af-4b3c-b64f-1416635ef88d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:26.109972 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d14e039f-02af-4b3c-b64f-1416635ef88d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:26.117389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-d14e039f-02af-4b3c-b64f-1416635ef88d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.150278 May 23 16:47:26.117977 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 129/246] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:25 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:27.134228 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-c2cd2471-b305-4f4a-854c-c8b4b124e917 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:27.134797 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-c2cd2471-b305-4f4a-854c-c8b4b124e917 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:27.139818 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=28 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:27.145164 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c2cd2471-b305-4f4a-854c-c8b4b124e917 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:27.145614 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c2cd2471-b305-4f4a-854c-c8b4b124e917 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:27.146381 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c2cd2471-b305-4f4a-854c-c8b4b124e917 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:27.146816 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c2cd2471-b305-4f4a-854c-c8b4b124e917 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:27.280467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-c2cd2471-b305-4f4a-854c-c8b4b124e917 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:27.288527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-c2cd2471-b305-4f4a-854c-c8b4b124e917 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.158211 May 23 16:47:27.289110 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 118/247] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:27 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:28.305527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-1122ca55-001c-4f63-838b-4ec728146548 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:28.306146 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-1122ca55-001c-4f63-838b-4ec728146548 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:28.312749 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1122ca55-001c-4f63-838b-4ec728146548 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:28.313203 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1122ca55-001c-4f63-838b-4ec728146548 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:28.313965 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1122ca55-001c-4f63-838b-4ec728146548 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:28.314395 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1122ca55-001c-4f63-838b-4ec728146548 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:28.441395 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-1122ca55-001c-4f63-838b-4ec728146548 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:28.443540 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:28.449877 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-1122ca55-001c-4f63-838b-4ec728146548 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.148254 May 23 16:47:28.450473 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 130/248] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:28 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:29.466967 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-5e5587b1-b23d-48bf-b3e0-cf0794f9e8d6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:29.467486 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-5e5587b1-b23d-48bf-b3e0-cf0794f9e8d6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:29.473948 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-5e5587b1-b23d-48bf-b3e0-cf0794f9e8d6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:29.474394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-5e5587b1-b23d-48bf-b3e0-cf0794f9e8d6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:29.475150 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-5e5587b1-b23d-48bf-b3e0-cf0794f9e8d6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:29.475583 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-5e5587b1-b23d-48bf-b3e0-cf0794f9e8d6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:29.611732 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-5e5587b1-b23d-48bf-b3e0-cf0794f9e8d6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:29.619536 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-5e5587b1-b23d-48bf-b3e0-cf0794f9e8d6 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.156482 May 23 16:47:29.620114 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 119/249] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:29 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:30.637233 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-4ac454f8-3b9d-490e-a36e-7e841e44b543 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:30.637855 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-4ac454f8-3b9d-490e-a36e-7e841e44b543 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:30.645388 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4ac454f8-3b9d-490e-a36e-7e841e44b543 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:30.645836 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4ac454f8-3b9d-490e-a36e-7e841e44b543 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:30.646664 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4ac454f8-3b9d-490e-a36e-7e841e44b543 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:30.647085 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4ac454f8-3b9d-490e-a36e-7e841e44b543 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:30.857750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-4ac454f8-3b9d-490e-a36e-7e841e44b543 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:30.865704 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-4ac454f8-3b9d-490e-a36e-7e841e44b543 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.232371 May 23 16:47:30.866263 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 131/250] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:30 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:31.884175 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ca2833ca-dd87-4731-9be6-ddd3949b2434 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:31.884823 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ca2833ca-dd87-4731-9be6-ddd3949b2434 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:31.891227 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ca2833ca-dd87-4731-9be6-ddd3949b2434 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:31.891678 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ca2833ca-dd87-4731-9be6-ddd3949b2434 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:31.892513 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ca2833ca-dd87-4731-9be6-ddd3949b2434 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:31.892953 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ca2833ca-dd87-4731-9be6-ddd3949b2434 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:32.018248 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ca2833ca-dd87-4731-9be6-ddd3949b2434 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:32.025712 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ca2833ca-dd87-4731-9be6-ddd3949b2434 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.145485 May 23 16:47:32.026279 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 120/251] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:31 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:33.042628 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-64b8d9cc-c5e5-4eb8-a163-994f592ef99c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:33.043245 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-64b8d9cc-c5e5-4eb8-a163-994f592ef99c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:33.049792 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-64b8d9cc-c5e5-4eb8-a163-994f592ef99c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:33.050249 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-64b8d9cc-c5e5-4eb8-a163-994f592ef99c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:33.051022 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-64b8d9cc-c5e5-4eb8-a163-994f592ef99c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:33.051465 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-64b8d9cc-c5e5-4eb8-a163-994f592ef99c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:33.182687 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-64b8d9cc-c5e5-4eb8-a163-994f592ef99c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:33.196126 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-64b8d9cc-c5e5-4eb8-a163-994f592ef99c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.153202 May 23 16:47:33.196126 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 132/252] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:33 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:34.222925 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-7691ee11-b031-4b76-9483-414f21278958 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:34.224209 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-7691ee11-b031-4b76-9483-414f21278958 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:34.237182 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7691ee11-b031-4b76-9483-414f21278958 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:34.237629 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7691ee11-b031-4b76-9483-414f21278958 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:34.238582 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7691ee11-b031-4b76-9483-414f21278958 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:34.239016 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7691ee11-b031-4b76-9483-414f21278958 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:34.368005 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7691ee11-b031-4b76-9483-414f21278958 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:34.375343 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-7691ee11-b031-4b76-9483-414f21278958 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.157096 May 23 16:47:34.376069 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 121/253] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:34 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:47:35.392258 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-55ffa03b-0a21-44e6-8383-6140f02ef005 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:35.392897 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-55ffa03b-0a21-44e6-8383-6140f02ef005 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:35.398879 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-55ffa03b-0a21-44e6-8383-6140f02ef005 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:35.399332 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-55ffa03b-0a21-44e6-8383-6140f02ef005 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:35.400102 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-55ffa03b-0a21-44e6-8383-6140f02ef005 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:35.400583 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-55ffa03b-0a21-44e6-8383-6140f02ef005 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:35.533603 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-55ffa03b-0a21-44e6-8383-6140f02ef005 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:35.541110 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-55ffa03b-0a21-44e6-8383-6140f02ef005 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.152877 May 23 16:47:35.541666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 133/254] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:35 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:36.558876 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-6d0ad943-63e0-4afd-a380-8c155afd931c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:36.559497 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-6d0ad943-63e0-4afd-a380-8c155afd931c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:36.567064 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6d0ad943-63e0-4afd-a380-8c155afd931c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:36.567519 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6d0ad943-63e0-4afd-a380-8c155afd931c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:36.568288 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6d0ad943-63e0-4afd-a380-8c155afd931c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:36.568804 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6d0ad943-63e0-4afd-a380-8c155afd931c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:36.695281 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-6d0ad943-63e0-4afd-a380-8c155afd931c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:36.702735 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-6d0ad943-63e0-4afd-a380-8c155afd931c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.147799 May 23 16:47:36.703303 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 122/255] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:36 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:37.719648 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-21a90ea2-43b9-4002-8fcb-9e7134953724 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:37.720206 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-21a90ea2-43b9-4002-8fcb-9e7134953724 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:37.726683 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-21a90ea2-43b9-4002-8fcb-9e7134953724 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:37.727023 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-21a90ea2-43b9-4002-8fcb-9e7134953724 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:37.727789 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-21a90ea2-43b9-4002-8fcb-9e7134953724 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:37.728230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-21a90ea2-43b9-4002-8fcb-9e7134953724 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:37.858464 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-21a90ea2-43b9-4002-8fcb-9e7134953724 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:37.866284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-21a90ea2-43b9-4002-8fcb-9e7134953724 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.150621 May 23 16:47:37.873187 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 134/256] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:37 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:38.884175 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-f8b20988-ee67-4df7-8d0d-9f9bc769950a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:38.884822 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-f8b20988-ee67-4df7-8d0d-9f9bc769950a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:38.892129 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f8b20988-ee67-4df7-8d0d-9f9bc769950a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:38.892692 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f8b20988-ee67-4df7-8d0d-9f9bc769950a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:38.893431 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f8b20988-ee67-4df7-8d0d-9f9bc769950a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:38.893868 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f8b20988-ee67-4df7-8d0d-9f9bc769950a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:38.897740 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=78 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:39.231871 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-f8b20988-ee67-4df7-8d0d-9f9bc769950a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:39.239319 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-f8b20988-ee67-4df7-8d0d-9f9bc769950a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.359040 May 23 16:47:39.243884 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 123/257] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:38 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:47:40.256375 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-ee03ef35-edbb-4fb1-bdd4-2a13d017eed5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:40.256989 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-ee03ef35-edbb-4fb1-bdd4-2a13d017eed5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:40.263002 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ee03ef35-edbb-4fb1-bdd4-2a13d017eed5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:40.263461 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ee03ef35-edbb-4fb1-bdd4-2a13d017eed5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:40.264222 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ee03ef35-edbb-4fb1-bdd4-2a13d017eed5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:40.264704 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ee03ef35-edbb-4fb1-bdd4-2a13d017eed5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:40.392790 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-ee03ef35-edbb-4fb1-bdd4-2a13d017eed5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:40.400282 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-ee03ef35-edbb-4fb1-bdd4-2a13d017eed5 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.147852 May 23 16:47:40.400870 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 135/258] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:40 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:41.418497 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-e2ec303a-aa76-415b-8afd-acc196b6fa9c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:41.419163 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-e2ec303a-aa76-415b-8afd-acc196b6fa9c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:41.426894 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e2ec303a-aa76-415b-8afd-acc196b6fa9c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:41.427348 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e2ec303a-aa76-415b-8afd-acc196b6fa9c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:41.428122 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e2ec303a-aa76-415b-8afd-acc196b6fa9c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:41.428591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e2ec303a-aa76-415b-8afd-acc196b6fa9c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:41.569397 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e2ec303a-aa76-415b-8afd-acc196b6fa9c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:41.577214 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-e2ec303a-aa76-415b-8afd-acc196b6fa9c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.162706 May 23 16:47:41.577822 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 124/259] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:41 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:42.596087 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-60ea9ef3-d2a4-4332-9737-d7b8b74cca35 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:42.596730 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-60ea9ef3-d2a4-4332-9737-d7b8b74cca35 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:42.602918 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-60ea9ef3-d2a4-4332-9737-d7b8b74cca35 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:42.603368 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-60ea9ef3-d2a4-4332-9737-d7b8b74cca35 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:42.604132 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-60ea9ef3-d2a4-4332-9737-d7b8b74cca35 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:42.604603 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-60ea9ef3-d2a4-4332-9737-d7b8b74cca35 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:42.745684 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-60ea9ef3-d2a4-4332-9737-d7b8b74cca35 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:42.753116 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-60ea9ef3-d2a4-4332-9737-d7b8b74cca35 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.161273 May 23 16:47:42.753677 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 136/260] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:42 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:43.770443 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-0280c143-bc74-4788-b332-5af461ce169a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:43.771047 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-0280c143-bc74-4788-b332-5af461ce169a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:43.777421 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0280c143-bc74-4788-b332-5af461ce169a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:43.777867 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0280c143-bc74-4788-b332-5af461ce169a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:43.780107 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0280c143-bc74-4788-b332-5af461ce169a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:43.780107 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0280c143-bc74-4788-b332-5af461ce169a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:43.907412 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-0280c143-bc74-4788-b332-5af461ce169a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:43.915127 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-0280c143-bc74-4788-b332-5af461ce169a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.149098 May 23 16:47:43.915784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 125/261] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:43 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:44.932630 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-82cac072-e45f-45fe-8334-bba3c14a0adb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:44.933244 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-82cac072-e45f-45fe-8334-bba3c14a0adb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:44.940224 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-82cac072-e45f-45fe-8334-bba3c14a0adb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:44.941059 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-82cac072-e45f-45fe-8334-bba3c14a0adb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:44.942450 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-82cac072-e45f-45fe-8334-bba3c14a0adb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:44.943271 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-82cac072-e45f-45fe-8334-bba3c14a0adb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:45.076731 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-82cac072-e45f-45fe-8334-bba3c14a0adb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:45.084898 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-82cac072-e45f-45fe-8334-bba3c14a0adb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.156094 May 23 16:47:45.085468 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 137/262] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:44 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:46.102013 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-7b87c04d-f034-4e55-bf2d-0e11b18dd5ef tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:46.102632 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-7b87c04d-f034-4e55-bf2d-0e11b18dd5ef tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:46.109815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7b87c04d-f034-4e55-bf2d-0e11b18dd5ef tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:46.110151 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7b87c04d-f034-4e55-bf2d-0e11b18dd5ef tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:46.111355 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7b87c04d-f034-4e55-bf2d-0e11b18dd5ef tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:46.112536 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7b87c04d-f034-4e55-bf2d-0e11b18dd5ef tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:46.244890 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7b87c04d-f034-4e55-bf2d-0e11b18dd5ef tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:46.253586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-7b87c04d-f034-4e55-bf2d-0e11b18dd5ef tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.155440 May 23 16:47:46.254164 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 126/263] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:46 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:47.270796 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-b5df43fc-bb73-4763-9e5c-05c7a793d585 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:47.271434 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-b5df43fc-bb73-4763-9e5c-05c7a793d585 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:47.277452 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b5df43fc-bb73-4763-9e5c-05c7a793d585 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:47.277894 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b5df43fc-bb73-4763-9e5c-05c7a793d585 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:47.278645 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b5df43fc-bb73-4763-9e5c-05c7a793d585 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:47.279078 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b5df43fc-bb73-4763-9e5c-05c7a793d585 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:47.406750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-b5df43fc-bb73-4763-9e5c-05c7a793d585 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:47.414914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-b5df43fc-bb73-4763-9e5c-05c7a793d585 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.148134 May 23 16:47:47.415478 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 138/264] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:47 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:48.432971 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-8691674d-c756-4738-9821-2d5a72e6296d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:48.433592 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-8691674d-c756-4738-9821-2d5a72e6296d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:48.440885 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8691674d-c756-4738-9821-2d5a72e6296d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:48.441339 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8691674d-c756-4738-9821-2d5a72e6296d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:48.442112 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8691674d-c756-4738-9821-2d5a72e6296d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:48.442552 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8691674d-c756-4738-9821-2d5a72e6296d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:48.572080 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8691674d-c756-4738-9821-2d5a72e6296d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:48.579507 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-8691674d-c756-4738-9821-2d5a72e6296d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.150405 May 23 16:47:48.580855 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 127/265] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:48 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:49.597972 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-8d3a02a2-259a-4f9a-a8ba-c37738037a7a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:49.599563 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-8d3a02a2-259a-4f9a-a8ba-c37738037a7a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:49.605001 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8d3a02a2-259a-4f9a-a8ba-c37738037a7a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:49.605451 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8d3a02a2-259a-4f9a-a8ba-c37738037a7a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:49.606251 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8d3a02a2-259a-4f9a-a8ba-c37738037a7a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:49.606705 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8d3a02a2-259a-4f9a-a8ba-c37738037a7a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:49.744823 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-8d3a02a2-259a-4f9a-a8ba-c37738037a7a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:49.752221 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-8d3a02a2-259a-4f9a-a8ba-c37738037a7a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.158821 May 23 16:47:49.752808 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 139/266] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:49 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:50.769614 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-6557b3f8-7ac1-4807-b79e-fd32d1fef079 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:50.770233 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-6557b3f8-7ac1-4807-b79e-fd32d1fef079 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:50.776803 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6557b3f8-7ac1-4807-b79e-fd32d1fef079 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:50.777257 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6557b3f8-7ac1-4807-b79e-fd32d1fef079 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:50.778022 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6557b3f8-7ac1-4807-b79e-fd32d1fef079 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:50.778469 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6557b3f8-7ac1-4807-b79e-fd32d1fef079 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:50.905536 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-6557b3f8-7ac1-4807-b79e-fd32d1fef079 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:50.913467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-6557b3f8-7ac1-4807-b79e-fd32d1fef079 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.147943 May 23 16:47:50.914037 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 128/267] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:50 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:51.930629 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-6a0080a9-b7b2-4a54-bef3-87e366860724 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:51.931231 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-6a0080a9-b7b2-4a54-bef3-87e366860724 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:51.937172 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a0080a9-b7b2-4a54-bef3-87e366860724 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:51.937617 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a0080a9-b7b2-4a54-bef3-87e366860724 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:51.938485 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a0080a9-b7b2-4a54-bef3-87e366860724 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:51.938914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a0080a9-b7b2-4a54-bef3-87e366860724 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:52.068255 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-6a0080a9-b7b2-4a54-bef3-87e366860724 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:52.075605 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-6a0080a9-b7b2-4a54-bef3-87e366860724 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.148803 May 23 16:47:52.076163 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 140/268] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:51 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:53.098886 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-b6eb09c8-3384-48df-b749-830706c4e4db tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:53.099471 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-b6eb09c8-3384-48df-b749-830706c4e4db tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:53.116992 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b6eb09c8-3384-48df-b749-830706c4e4db tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:53.117797 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b6eb09c8-3384-48df-b749-830706c4e4db tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:53.119093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b6eb09c8-3384-48df-b749-830706c4e4db tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:53.119936 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b6eb09c8-3384-48df-b749-830706c4e4db tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:53.278812 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b6eb09c8-3384-48df-b749-830706c4e4db tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:53.286640 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-b6eb09c8-3384-48df-b749-830706c4e4db tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.198010 May 23 16:47:53.287223 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 129/269] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:53 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:54.303630 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e99d345a-7d22-4e57-9041-e6b35730068c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:54.304243 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e99d345a-7d22-4e57-9041-e6b35730068c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:54.306165 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=26 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:54.310848 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e99d345a-7d22-4e57-9041-e6b35730068c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:54.311297 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e99d345a-7d22-4e57-9041-e6b35730068c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:54.312050 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e99d345a-7d22-4e57-9041-e6b35730068c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:54.312525 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e99d345a-7d22-4e57-9041-e6b35730068c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:54.439594 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e99d345a-7d22-4e57-9041-e6b35730068c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:54.447882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e99d345a-7d22-4e57-9041-e6b35730068c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.148189 May 23 16:47:54.448486 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 141/270] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:54 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:55.465724 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-288e1411-b210-41fe-a94a-99f59093b606 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:55.466287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-288e1411-b210-41fe-a94a-99f59093b606 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:55.472503 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-288e1411-b210-41fe-a94a-99f59093b606 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:55.473535 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-288e1411-b210-41fe-a94a-99f59093b606 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:55.474310 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-288e1411-b210-41fe-a94a-99f59093b606 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:55.474803 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-288e1411-b210-41fe-a94a-99f59093b606 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:55.608618 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-288e1411-b210-41fe-a94a-99f59093b606 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:55.616174 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-288e1411-b210-41fe-a94a-99f59093b606 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1501 microversion: 2.1 time: 0.154584 May 23 16:47:55.616785 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 130/271] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:55 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:55.632875 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c9850ffd-ac49-4be7-b09f-5cd2305738a0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d789ae37-1d1d-450a-9e15-811a90d7a3b3"}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:47:55.633995 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-c9850ffd-ac49-4be7-b09f-5cd2305738a0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:55.639974 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c9850ffd-ac49-4be7-b09f-5cd2305738a0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:55.640482 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c9850ffd-ac49-4be7-b09f-5cd2305738a0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:55.641224 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c9850ffd-ac49-4be7-b09f-5cd2305738a0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:55.641657 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c9850ffd-ac49-4be7-b09f-5cd2305738a0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:55.665557 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-c9850ffd-ac49-4be7-b09f-5cd2305738a0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] HTTP exception thrown: Cannot 'attach_volume' instance 2ff57504-04ce-414c-b676-fb6bcec4cccf while it is in vm_state rescued May 23 16:47:55.667230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c9850ffd-ac49-4be7-b09f-5cd2305738a0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Request method failure captured: May 23 16:47:55.667230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: POST /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf/os-volume_attachments HTTP/1.1 May 23 16:47:55.667230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:47:55.667230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:47:55.667230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:47:55.667230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 74 May 23 16:47:55.667230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:47:55.667230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:47:55.667230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:47:55.667230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:47:55.667230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7o2WukSo8MVh2vnrT0Gb8xsUoVX_gA4ZRtYP_ktCPbSO2DDauFM_C7u7kWk3VGOZRNEQJWCkkdSQViJZ1u-fzhESfTWj231c6MIBn8Mmt4wfYftDRBPMAgBmDWUt7URCKm3USy34i6WhHz3kcqn7lqeWxjid60wtGzqVjLxfEi2w6I May 23 16:47:55.667230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:47:55.667230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:47:55.667230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:47:55.667230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:47:55.667230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:47:55.667230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:47:55.667230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: 8c4eba5d39e545cbb8380490c86045f0 May 23 16:47:55.667230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-8767631 May 23 16:47:55.667230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:47:55.667230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:47:55.668788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8c4eba5d39e545cbb8380490c86045f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8c4eba5d39e545cbb8380490c86045f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8c4eba5d39e545cbb8380490c86045f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8c4eba5d39e545cbb8380490c86045f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:47:55.668788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-ServerRescueNegativeTestJSON-8767631 May 23 16:47:55.668788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: 8c4eba5d39e545cbb8380490c86045f0 May 23 16:47:55.668788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-8767631 May 23 16:47:55.668788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-ServerRescueNegativeTestJSON-8767631-project May 23 16:47:55.668788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:47:55.668788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:47:55.668788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: f14f77bc65fd4ff0bc1ec6de35846f14 May 23 16:47:55.668788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-ServerRescueNegativeTestJSON-8767631-project May 23 16:47:55.668788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: May 23 16:47:55.668788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {"volumeAttachment": {"volumeId": "d789ae37-1d1d-450a-9e15-811a90d7a3b3"}} May 23 16:47:55.668788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 16:47:55.669619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Cannot 'attach_volume' instance 2ff57504-04ce-414c-b676-fb6bcec4cccf while it is in vm_state rescued May 23 16:47:55.669619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'server_id': '2ff57504-04ce-414c-b676-fb6bcec4cccf', 'body': {'volumeAttachment': {'volumeId': 'd789ae37-1d1d-450a-9e15-811a90d7a3b3'}}} May 23 16:47:55.669619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:47:55.669619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:47:55.669619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 16:47:55.669619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 16:47:55.669619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 16:47:55.669619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 16:47:55.669619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 23 16:47:55.669619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 23 16:47:55.669619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2ff57504-04ce-414c-b676-fb6bcec4cccf in vm_state rescued. Cannot attach_volume while the instance is in this state. May 23 16:47:55.669619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:47:55.669619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:47:55.669619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:47:55.669619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:47:55.669619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:47:55.669619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:47:55.669619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:47:55.669619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:47:55.670727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:47:55.670727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:47:55.670727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 16:47:55.670727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 16:47:55.670727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 16:47:55.670727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 16:47:55.670727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 16:47:55.670727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 16:47:55.670727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 23 16:47:55.670727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 23 16:47:55.670727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 23 16:47:55.670727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 23 16:47:55.670727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2ff57504-04ce-414c-b676-fb6bcec4cccf while it is in vm_state rescued May 23 16:47:55.670727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:47:55.670727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:47:55.670727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:47:55.670727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:47:55.670727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:47:55.670727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:47:55.671775 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:47:55.671775 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:47:55.671775 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2ff57504-04ce-414c-b676-fb6bcec4cccf while it is in vm_state rescued May 23 16:47:55.671775 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:47:55.671775 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c9850ffd-ac49-4be7-b09f-5cd2305738a0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Returning 409 to user: Cannot 'attach_volume' instance 2ff57504-04ce-414c-b676-fb6bcec4cccf while it is in vm_state rescued {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:47:55.671775 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-c9850ffd-ac49-4be7-b09f-5cd2305738a0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "POST /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040139 May 23 16:47:55.671775 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 142/272] 10.222.0.74 () {60 vars in 1322 bytes} [Mon May 23 16:47:55 2022] POST /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 23 16:47:55.678149 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-89badd88-03f9-4111-aa9b-db673c2f8459 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:47:55.678699 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-89badd88-03f9-4111-aa9b-db673c2f8459 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:55.684827 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-89badd88-03f9-4111-aa9b-db673c2f8459 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:55.685286 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-89badd88-03f9-4111-aa9b-db673c2f8459 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:55.686058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-89badd88-03f9-4111-aa9b-db673c2f8459 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:55.686501 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-89badd88-03f9-4111-aa9b-db673c2f8459 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:55.900644 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-89badd88-03f9-4111-aa9b-db673c2f8459 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "POST /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf/action" status: 202 len: 0 microversion: 2.1 time: 0.226444 May 23 16:47:55.901303 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 131/273] 10.222.0.74 () {60 vars in 1277 bytes} [Mon May 23 16:47:55 2022] POST /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:47:55.909603 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-aea4366d-17bc-41d6-a584-71c42feff6c8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:55.910218 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-aea4366d-17bc-41d6-a584-71c42feff6c8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:55.916422 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-aea4366d-17bc-41d6-a584-71c42feff6c8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:55.916875 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-aea4366d-17bc-41d6-a584-71c42feff6c8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:55.917638 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-aea4366d-17bc-41d6-a584-71c42feff6c8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:55.918075 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-aea4366d-17bc-41d6-a584-71c42feff6c8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:56.128839 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-aea4366d-17bc-41d6-a584-71c42feff6c8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:56.136967 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-aea4366d-17bc-41d6-a584-71c42feff6c8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1509 microversion: 2.1 time: 0.231230 May 23 16:47:56.137532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 143/274] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:55 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1509 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:57.156000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-562ae570-26fc-4ec2-bb59-f465b67f844c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:57.156649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-562ae570-26fc-4ec2-bb59-f465b67f844c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:57.163872 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-562ae570-26fc-4ec2-bb59-f465b67f844c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:57.164340 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-562ae570-26fc-4ec2-bb59-f465b67f844c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:57.165140 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-562ae570-26fc-4ec2-bb59-f465b67f844c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:57.165578 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-562ae570-26fc-4ec2-bb59-f465b67f844c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:57.296064 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-562ae570-26fc-4ec2-bb59-f465b67f844c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:57.304286 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-562ae570-26fc-4ec2-bb59-f465b67f844c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1509 microversion: 2.1 time: 0.152966 May 23 16:47:57.304874 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 132/275] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:57 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:58.322124 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-add2280f-d4f2-4b27-80ee-26ae0335ca42 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:58.322728 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-add2280f-d4f2-4b27-80ee-26ae0335ca42 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:58.328692 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-add2280f-d4f2-4b27-80ee-26ae0335ca42 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:58.329140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-add2280f-d4f2-4b27-80ee-26ae0335ca42 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:58.329894 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-add2280f-d4f2-4b27-80ee-26ae0335ca42 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:58.330594 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-add2280f-d4f2-4b27-80ee-26ae0335ca42 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:58.460709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-add2280f-d4f2-4b27-80ee-26ae0335ca42 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:58.468029 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-add2280f-d4f2-4b27-80ee-26ae0335ca42 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1509 microversion: 2.1 time: 0.150326 May 23 16:47:58.468561 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 144/276] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:58 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:47:59.484139 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-7532bad1-43bf-42d8-b3ae-cc1f2b388f7f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:47:59.484790 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-7532bad1-43bf-42d8-b3ae-cc1f2b388f7f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:47:59.487218 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=30 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:47:59.492618 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7532bad1-43bf-42d8-b3ae-cc1f2b388f7f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:59.493077 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7532bad1-43bf-42d8-b3ae-cc1f2b388f7f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:59.493890 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7532bad1-43bf-42d8-b3ae-cc1f2b388f7f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:47:59.494334 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7532bad1-43bf-42d8-b3ae-cc1f2b388f7f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:47:59.624589 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7532bad1-43bf-42d8-b3ae-cc1f2b388f7f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:47:59.632443 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-7532bad1-43bf-42d8-b3ae-cc1f2b388f7f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1509 microversion: 2.1 time: 0.152171 May 23 16:47:59.633012 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 133/277] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:47:59 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:00.650367 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e70c8b88-8bb7-417d-8364-949ad794efed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:00.650901 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e70c8b88-8bb7-417d-8364-949ad794efed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:00.657066 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e70c8b88-8bb7-417d-8364-949ad794efed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:00.657517 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e70c8b88-8bb7-417d-8364-949ad794efed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:00.658285 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e70c8b88-8bb7-417d-8364-949ad794efed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:00.658727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e70c8b88-8bb7-417d-8364-949ad794efed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:00.787150 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e70c8b88-8bb7-417d-8364-949ad794efed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:00.794485 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e70c8b88-8bb7-417d-8364-949ad794efed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1509 microversion: 2.1 time: 0.148836 May 23 16:48:00.795038 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 145/278] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:00 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:01.811891 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-8a3a3fe0-64ed-4256-a664-7bbee4c449d1 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:01.812583 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-8a3a3fe0-64ed-4256-a664-7bbee4c449d1 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:01.819339 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8a3a3fe0-64ed-4256-a664-7bbee4c449d1 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:01.819791 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8a3a3fe0-64ed-4256-a664-7bbee4c449d1 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:01.820591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8a3a3fe0-64ed-4256-a664-7bbee4c449d1 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:01.821042 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8a3a3fe0-64ed-4256-a664-7bbee4c449d1 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:01.948395 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8a3a3fe0-64ed-4256-a664-7bbee4c449d1 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:01.955987 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-8a3a3fe0-64ed-4256-a664-7bbee4c449d1 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1509 microversion: 2.1 time: 0.147975 May 23 16:48:01.956596 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 134/279] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:01 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:02.972638 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-89571ba8-a396-4c74-a993-f277af0662a8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:02.973246 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-89571ba8-a396-4c74-a993-f277af0662a8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:02.979368 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-89571ba8-a396-4c74-a993-f277af0662a8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:02.979816 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-89571ba8-a396-4c74-a993-f277af0662a8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:02.980628 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-89571ba8-a396-4c74-a993-f277af0662a8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:02.981059 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-89571ba8-a396-4c74-a993-f277af0662a8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:03.106758 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-89571ba8-a396-4c74-a993-f277af0662a8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:03.108936 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=94 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:03.114602 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-89571ba8-a396-4c74-a993-f277af0662a8 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1509 microversion: 2.1 time: 0.145824 May 23 16:48:03.115161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 146/280] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:02 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1509 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:04.132326 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-98c8a43b-47d9-4ffc-a6be-3cac44e62d91 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:04.135900 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-98c8a43b-47d9-4ffc-a6be-3cac44e62d91 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:04.140331 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-98c8a43b-47d9-4ffc-a6be-3cac44e62d91 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:04.140770 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-98c8a43b-47d9-4ffc-a6be-3cac44e62d91 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:04.141766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-98c8a43b-47d9-4ffc-a6be-3cac44e62d91 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:04.142196 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-98c8a43b-47d9-4ffc-a6be-3cac44e62d91 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:04.277464 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-98c8a43b-47d9-4ffc-a6be-3cac44e62d91 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:04.287932 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-98c8a43b-47d9-4ffc-a6be-3cac44e62d91 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1509 microversion: 2.1 time: 0.156514 May 23 16:48:04.287932 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 135/281] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:04 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:05.302251 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e6e09212-9a06-4d41-a7d4-840a21ca7ca4 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:05.302987 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e6e09212-9a06-4d41-a7d4-840a21ca7ca4 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:05.310168 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e6e09212-9a06-4d41-a7d4-840a21ca7ca4 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:05.310634 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e6e09212-9a06-4d41-a7d4-840a21ca7ca4 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:05.311385 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e6e09212-9a06-4d41-a7d4-840a21ca7ca4 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:05.311823 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e6e09212-9a06-4d41-a7d4-840a21ca7ca4 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:05.444279 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e6e09212-9a06-4d41-a7d4-840a21ca7ca4 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:05.452917 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e6e09212-9a06-4d41-a7d4-840a21ca7ca4 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1515 microversion: 2.1 time: 0.154263 May 23 16:48:05.454103 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 147/282] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:05 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:08.144087 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-15e889da-db32-4e23-a951-a1fbd334381b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Action: 'create', calling method: .version_select at 0x7f224c627670>, body: {"keypair": {"name": "tempest-keypair-1608691226", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdWUw/4pmeHQvNa/qdXh94CNVP3bNVUVy0W6fRXGU2X9QUKqI+MLAgeM2/4/pC36uI2XAc8dI/JW/1Y9UZGgm33LbGgC714MyXqz5rHqmmHVu3yPZsEFVt3sDqVXt3vjw=="}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:48:08.159299 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-15e889da-db32-4e23-a951-a1fbd334381b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Getting quotas for project 8c4eba5d39e545cbb8380490c86045f0. Resources: {'key_pairs'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:48:08.163093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-15e889da-db32-4e23-a951-a1fbd334381b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Getting quotas for user f14f77bc65fd4ff0bc1ec6de35846f14 and project 8c4eba5d39e545cbb8380490c86045f0. Resources: {'key_pairs'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:48:08.292321 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-15e889da-db32-4e23-a951-a1fbd334381b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.151989 May 23 16:48:08.292936 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 136/283] 10.222.0.74 () {60 vars in 1158 bytes} [Mon May 23 16:48:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:48:10.687914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-055eb411-9b3f-4fda-9187-a122e7a8b54b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1674876051", "imageRef": "96972e76-879d-4149-a713-a94529892aad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "480e0590-a5f7-42c2-9f4d-a26535d80892"}], "security_groups": [{"name": "tempest-securitygroup--801069451"}], "key_name": "tempest-keypair-1608691226", "user_data": "}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:48:10.786007 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.network.neutron [None req-055eb411-9b3f-4fda-9187-a122e7a8b54b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] validate_networks() for [('480e0590-a5f7-42c2-9f4d-a26535d80892', None, None, None, None, None)] {{(pid=124715) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 16:48:11.144099 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-055eb411-9b3f-4fda-9187-a122e7a8b54b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Flavor limits 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 16:48:11.144570 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-055eb411-9b3f-4fda-9187-a122e7a8b54b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Image limits 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 16:48:11.145047 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-055eb411-9b3f-4fda-9187-a122e7a8b54b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Flavor pref 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 16:48:11.145485 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-055eb411-9b3f-4fda-9187-a122e7a8b54b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Image pref 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 16:48:11.145899 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-055eb411-9b3f-4fda-9187-a122e7a8b54b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 16:48:11.155114 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-055eb411-9b3f-4fda-9187-a122e7a8b54b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:11.155561 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-055eb411-9b3f-4fda-9187-a122e7a8b54b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:11.156380 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-055eb411-9b3f-4fda-9187-a122e7a8b54b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:11.156822 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-055eb411-9b3f-4fda-9187-a122e7a8b54b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:11.174431 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-055eb411-9b3f-4fda-9187-a122e7a8b54b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Getting quotas for project 8c4eba5d39e545cbb8380490c86045f0. Resources: {'cores', 'instances', 'ram'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:48:11.178300 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-055eb411-9b3f-4fda-9187-a122e7a8b54b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Getting quotas for user f14f77bc65fd4ff0bc1ec6de35846f14 and project 8c4eba5d39e545cbb8380490c86045f0. Resources: {'cores', 'instances', 'ram'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:48:11.189232 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-055eb411-9b3f-4fda-9187-a122e7a8b54b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Going to run 1 instances... {{(pid=124715) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 16:48:11.191557 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-055eb411-9b3f-4fda-9187-a122e7a8b54b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96972e76-879d-4149-a713-a94529892aad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 16:48:11.321160 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-055eb411-9b3f-4fda-9187-a122e7a8b54b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.637458 May 23 16:48:11.321797 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 148/284] 10.222.0.74 () {60 vars in 1146 bytes} [Mon May 23 16:48:10 2022] POST /compute/v2.1/servers => generated 408 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 16:48:11.332553 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-7f0be483-7b9e-4164-a393-039f3d2e4c01 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:11.333168 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-7f0be483-7b9e-4164-a393-039f3d2e4c01 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:11.389123 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7f0be483-7b9e-4164-a393-039f3d2e4c01 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:11.396953 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-7f0be483-7b9e-4164-a393-039f3d2e4c01 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1246 microversion: 2.1 time: 0.068994 May 23 16:48:11.397520 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 137/285] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:11 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1246 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:12.415130 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-109365ae-453b-495d-899c-0c49139827b7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:12.415774 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-109365ae-453b-495d-899c-0c49139827b7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:12.422483 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-109365ae-453b-495d-899c-0c49139827b7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:12.422943 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-109365ae-453b-495d-899c-0c49139827b7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:12.423724 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-109365ae-453b-495d-899c-0c49139827b7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:12.424162 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-109365ae-453b-495d-899c-0c49139827b7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:12.483303 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-109365ae-453b-495d-899c-0c49139827b7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:12.490670 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-109365ae-453b-495d-899c-0c49139827b7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1250 microversion: 2.1 time: 0.079546 May 23 16:48:12.491230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 149/286] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:12 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1250 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:13.507707 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-644ff320-9555-4560-bebe-edfe5779a9d0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:13.508366 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-644ff320-9555-4560-bebe-edfe5779a9d0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:13.514889 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-644ff320-9555-4560-bebe-edfe5779a9d0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:13.515343 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-644ff320-9555-4560-bebe-edfe5779a9d0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:13.516110 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-644ff320-9555-4560-bebe-edfe5779a9d0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:13.516574 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-644ff320-9555-4560-bebe-edfe5779a9d0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:13.519481 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:13.580714 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-644ff320-9555-4560-bebe-edfe5779a9d0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:13.587956 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-644ff320-9555-4560-bebe-edfe5779a9d0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1242 microversion: 2.1 time: 0.084224 May 23 16:48:13.588550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 138/287] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:13 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:14.605796 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a58dea9d-b634-4c59-912e-55000976e51e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:14.606903 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a58dea9d-b634-4c59-912e-55000976e51e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:14.613296 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a58dea9d-b634-4c59-912e-55000976e51e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:14.613747 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a58dea9d-b634-4c59-912e-55000976e51e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:14.614652 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a58dea9d-b634-4c59-912e-55000976e51e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:14.615122 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a58dea9d-b634-4c59-912e-55000976e51e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:14.675517 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a58dea9d-b634-4c59-912e-55000976e51e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:14.682871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a58dea9d-b634-4c59-912e-55000976e51e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1242 microversion: 2.1 time: 0.081497 May 23 16:48:14.684098 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 150/288] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:14 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:15.702435 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-9d5cfb0f-44d0-4fc2-9053-d76782cf9722 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:15.703570 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-9d5cfb0f-44d0-4fc2-9053-d76782cf9722 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:15.710866 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9d5cfb0f-44d0-4fc2-9053-d76782cf9722 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:15.716234 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9d5cfb0f-44d0-4fc2-9053-d76782cf9722 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:15.716234 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9d5cfb0f-44d0-4fc2-9053-d76782cf9722 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:15.716234 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9d5cfb0f-44d0-4fc2-9053-d76782cf9722 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:15.775768 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-9d5cfb0f-44d0-4fc2-9053-d76782cf9722 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:15.783916 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-9d5cfb0f-44d0-4fc2-9053-d76782cf9722 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1298 microversion: 2.1 time: 0.087331 May 23 16:48:15.784517 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 139/289] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:15 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:16.801800 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-6965fd96-fde2-4958-afa3-e44c7cff2734 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:16.802528 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-6965fd96-fde2-4958-afa3-e44c7cff2734 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:16.809819 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6965fd96-fde2-4958-afa3-e44c7cff2734 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:16.810281 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6965fd96-fde2-4958-afa3-e44c7cff2734 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:16.811077 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6965fd96-fde2-4958-afa3-e44c7cff2734 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:16.811520 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6965fd96-fde2-4958-afa3-e44c7cff2734 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:16.884324 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-6965fd96-fde2-4958-afa3-e44c7cff2734 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:16.892481 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-6965fd96-fde2-4958-afa3-e44c7cff2734 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1298 microversion: 2.1 time: 0.094671 May 23 16:48:16.893071 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 151/290] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:16 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:17.909552 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-b62d4c85-3911-41de-b212-71abeaed1b3b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:17.910929 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-b62d4c85-3911-41de-b212-71abeaed1b3b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:17.917530 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b62d4c85-3911-41de-b212-71abeaed1b3b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:17.918824 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b62d4c85-3911-41de-b212-71abeaed1b3b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:17.919621 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b62d4c85-3911-41de-b212-71abeaed1b3b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:17.920104 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b62d4c85-3911-41de-b212-71abeaed1b3b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:18.131659 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b62d4c85-3911-41de-b212-71abeaed1b3b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:18.146764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-b62d4c85-3911-41de-b212-71abeaed1b3b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1371 microversion: 2.1 time: 0.240571 May 23 16:48:18.156331 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 140/291] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:17 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:18.830151 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-1f513386-07e2-4991-809e-29ce3035572c req-d2a1277e-00af-4e70-ab74-23c4adfa3a49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a3c1df-8e11-4485-a5ef-fa843b4362d3", "tag": "e00c55e6-6b89-4971-bceb-0a87e0ee6987"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:48:18.843434 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-1f513386-07e2-4991-809e-29ce3035572c req-d2a1277e-00af-4e70-ab74-23c4adfa3a49 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:18.843868 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-1f513386-07e2-4991-809e-29ce3035572c req-d2a1277e-00af-4e70-ab74-23c4adfa3a49 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:18.856744 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-1f513386-07e2-4991-809e-29ce3035572c req-d2a1277e-00af-4e70-ab74-23c4adfa3a49 service nova] Creating event network-changed:e00c55e6-6b89-4971-bceb-0a87e0ee6987 for instance 14a3c1df-8e11-4485-a5ef-fa843b4362d3 on hv-cinder-83925 May 23 16:48:18.867731 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-1f513386-07e2-4991-809e-29ce3035572c req-d2a1277e-00af-4e70-ab74-23c4adfa3a49 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037144 May 23 16:48:18.867731 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 152/292] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:48:19.166023 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-df1fab98-a5cf-48f7-b886-6d960794979e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:19.167216 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-df1fab98-a5cf-48f7-b886-6d960794979e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:19.175363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-df1fab98-a5cf-48f7-b886-6d960794979e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:19.175790 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-df1fab98-a5cf-48f7-b886-6d960794979e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:19.176572 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-df1fab98-a5cf-48f7-b886-6d960794979e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:19.177052 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-df1fab98-a5cf-48f7-b886-6d960794979e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:19.398882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-df1fab98-a5cf-48f7-b886-6d960794979e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:19.409007 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-df1fab98-a5cf-48f7-b886-6d960794979e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1371 microversion: 2.1 time: 0.246449 May 23 16:48:19.418708 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 141/293] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:19 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1371 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:20.426715 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-ef3b5098-56d2-4b89-a43b-8904aa6b5a14 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:20.427423 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-ef3b5098-56d2-4b89-a43b-8904aa6b5a14 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:20.435686 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ef3b5098-56d2-4b89-a43b-8904aa6b5a14 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:20.436401 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ef3b5098-56d2-4b89-a43b-8904aa6b5a14 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:20.437431 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ef3b5098-56d2-4b89-a43b-8904aa6b5a14 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:20.437806 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ef3b5098-56d2-4b89-a43b-8904aa6b5a14 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:20.575680 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-ef3b5098-56d2-4b89-a43b-8904aa6b5a14 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:20.583546 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-ef3b5098-56d2-4b89-a43b-8904aa6b5a14 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1371 microversion: 2.1 time: 0.161332 May 23 16:48:20.584081 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 153/294] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:20 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:21.600927 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-716accad-b591-4a6e-880c-5af0713e48b7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:21.602060 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-716accad-b591-4a6e-880c-5af0713e48b7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:21.604427 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=6 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:21.610058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-716accad-b591-4a6e-880c-5af0713e48b7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:21.610504 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-716accad-b591-4a6e-880c-5af0713e48b7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:21.611270 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-716accad-b591-4a6e-880c-5af0713e48b7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:21.611787 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-716accad-b591-4a6e-880c-5af0713e48b7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:21.745775 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-716accad-b591-4a6e-880c-5af0713e48b7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:21.754749 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-716accad-b591-4a6e-880c-5af0713e48b7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1371 microversion: 2.1 time: 0.157763 May 23 16:48:21.755342 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 142/295] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:21 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:22.772679 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-ddf506e9-6a2a-4382-aeba-bbbdd1703373 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:22.773299 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-ddf506e9-6a2a-4382-aeba-bbbdd1703373 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:22.775303 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=2 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:22.775954 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=6 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:22.780820 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ddf506e9-6a2a-4382-aeba-bbbdd1703373 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:22.781279 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ddf506e9-6a2a-4382-aeba-bbbdd1703373 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:22.782046 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ddf506e9-6a2a-4382-aeba-bbbdd1703373 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:22.782490 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ddf506e9-6a2a-4382-aeba-bbbdd1703373 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:22.954528 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-ddf506e9-6a2a-4382-aeba-bbbdd1703373 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:22.963412 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-ddf506e9-6a2a-4382-aeba-bbbdd1703373 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1371 microversion: 2.1 time: 0.194650 May 23 16:48:22.963993 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 154/296] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:22 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:23.983707 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-dc83ca31-9d55-483c-8dc9-30e8c0306a7a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:23.985671 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-dc83ca31-9d55-483c-8dc9-30e8c0306a7a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:23.992606 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dc83ca31-9d55-483c-8dc9-30e8c0306a7a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:23.993249 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dc83ca31-9d55-483c-8dc9-30e8c0306a7a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:23.994294 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dc83ca31-9d55-483c-8dc9-30e8c0306a7a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:23.995014 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dc83ca31-9d55-483c-8dc9-30e8c0306a7a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:24.134958 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-dc83ca31-9d55-483c-8dc9-30e8c0306a7a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:24.142583 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-dc83ca31-9d55-483c-8dc9-30e8c0306a7a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1371 microversion: 2.1 time: 0.165588 May 23 16:48:24.143887 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 143/297] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:23 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:25.159828 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7cfd9847-520b-4b7c-a7b4-6340b78b6201 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:25.160475 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-7cfd9847-520b-4b7c-a7b4-6340b78b6201 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:25.163442 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:25.168991 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7cfd9847-520b-4b7c-a7b4-6340b78b6201 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:25.169525 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7cfd9847-520b-4b7c-a7b4-6340b78b6201 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:25.170301 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7cfd9847-520b-4b7c-a7b4-6340b78b6201 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:25.170747 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7cfd9847-520b-4b7c-a7b4-6340b78b6201 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:25.305723 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-7cfd9847-520b-4b7c-a7b4-6340b78b6201 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:25.313921 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-7cfd9847-520b-4b7c-a7b4-6340b78b6201 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1371 microversion: 2.1 time: 0.157979 May 23 16:48:25.314481 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 155/298] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:25 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:26.331561 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-45bdaf28-57fb-43ad-92f1-cbe3c4027cc2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:26.332180 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-45bdaf28-57fb-43ad-92f1-cbe3c4027cc2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:26.338761 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-45bdaf28-57fb-43ad-92f1-cbe3c4027cc2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:26.339214 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-45bdaf28-57fb-43ad-92f1-cbe3c4027cc2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:26.340103 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-45bdaf28-57fb-43ad-92f1-cbe3c4027cc2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:26.340478 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-45bdaf28-57fb-43ad-92f1-cbe3c4027cc2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:26.475133 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-45bdaf28-57fb-43ad-92f1-cbe3c4027cc2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:26.482825 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-45bdaf28-57fb-43ad-92f1-cbe3c4027cc2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1371 microversion: 2.1 time: 0.155314 May 23 16:48:26.483446 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 144/299] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:26 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:48:27.500725 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-16e0f134-a1d6-4cc6-a0af-14b83eec142a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:27.501356 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-16e0f134-a1d6-4cc6-a0af-14b83eec142a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:27.507568 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-16e0f134-a1d6-4cc6-a0af-14b83eec142a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:27.508020 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-16e0f134-a1d6-4cc6-a0af-14b83eec142a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:27.509817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-16e0f134-a1d6-4cc6-a0af-14b83eec142a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:27.509817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-16e0f134-a1d6-4cc6-a0af-14b83eec142a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:27.642270 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-16e0f134-a1d6-4cc6-a0af-14b83eec142a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:27.649711 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-16e0f134-a1d6-4cc6-a0af-14b83eec142a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1371 microversion: 2.1 time: 0.153419 May 23 16:48:27.650272 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 156/300] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:27 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:28.667138 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-6db48535-a902-4790-af24-c7a2eda26f3a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:28.667759 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-6db48535-a902-4790-af24-c7a2eda26f3a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:28.675365 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6db48535-a902-4790-af24-c7a2eda26f3a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:28.675882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6db48535-a902-4790-af24-c7a2eda26f3a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:28.676712 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6db48535-a902-4790-af24-c7a2eda26f3a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:28.677157 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6db48535-a902-4790-af24-c7a2eda26f3a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:28.820564 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-6db48535-a902-4790-af24-c7a2eda26f3a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:28.828555 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-6db48535-a902-4790-af24-c7a2eda26f3a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1371 microversion: 2.1 time: 0.165264 May 23 16:48:28.829140 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 145/301] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:28 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:29.431522 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-28d0082d-ab6a-4a3a-86c5-186cd549bcaa req-24600c81-3345-4501-998b-4196ce3f6de1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a3c1df-8e11-4485-a5ef-fa843b4362d3", "name": "network-vif-plugged", "status": "completed", "tag": "e00c55e6-6b89-4971-bceb-0a87e0ee6987"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:48:29.439979 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-28d0082d-ab6a-4a3a-86c5-186cd549bcaa req-24600c81-3345-4501-998b-4196ce3f6de1 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:29.440474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-28d0082d-ab6a-4a3a-86c5-186cd549bcaa req-24600c81-3345-4501-998b-4196ce3f6de1 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:29.452744 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-28d0082d-ab6a-4a3a-86c5-186cd549bcaa req-24600c81-3345-4501-998b-4196ce3f6de1 service nova] Creating event network-vif-plugged:e00c55e6-6b89-4971-bceb-0a87e0ee6987 for instance 14a3c1df-8e11-4485-a5ef-fa843b4362d3 on hv-cinder-83925 May 23 16:48:29.458056 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-28d0082d-ab6a-4a3a-86c5-186cd549bcaa req-24600c81-3345-4501-998b-4196ce3f6de1 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030299 May 23 16:48:29.458636 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 157/302] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:48:29.853492 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-eb0ea683-7127-426f-9410-d7feb6e860dd tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:29.853492 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-eb0ea683-7127-426f-9410-d7feb6e860dd tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:29.853492 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:48:29.857080 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-eb0ea683-7127-426f-9410-d7feb6e860dd tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:29.857844 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-eb0ea683-7127-426f-9410-d7feb6e860dd tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:29.858634 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-eb0ea683-7127-426f-9410-d7feb6e860dd tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:29.859081 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-eb0ea683-7127-426f-9410-d7feb6e860dd tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:29.994757 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-eb0ea683-7127-426f-9410-d7feb6e860dd tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:30.002747 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-eb0ea683-7127-426f-9410-d7feb6e860dd tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1371 microversion: 2.1 time: 0.159801 May 23 16:48:30.003314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 146/303] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:29 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:31.020495 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-4ca12650-1d3f-4928-a4ef-3124c1ee5d4d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:31.021224 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-4ca12650-1d3f-4928-a4ef-3124c1ee5d4d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:31.027661 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4ca12650-1d3f-4928-a4ef-3124c1ee5d4d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:31.028112 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4ca12650-1d3f-4928-a4ef-3124c1ee5d4d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:31.029148 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4ca12650-1d3f-4928-a4ef-3124c1ee5d4d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:31.030205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4ca12650-1d3f-4928-a4ef-3124c1ee5d4d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:31.247107 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-4ca12650-1d3f-4928-a4ef-3124c1ee5d4d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:31.255451 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-4ca12650-1d3f-4928-a4ef-3124c1ee5d4d tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1371 microversion: 2.1 time: 0.239279 May 23 16:48:31.256019 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 158/304] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:31 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:32.273040 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-561c5d47-0245-48ef-a45f-0467a776967e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:32.273660 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-561c5d47-0245-48ef-a45f-0467a776967e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:32.281153 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-561c5d47-0245-48ef-a45f-0467a776967e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:32.281610 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-561c5d47-0245-48ef-a45f-0467a776967e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:32.282390 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-561c5d47-0245-48ef-a45f-0467a776967e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:32.282835 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-561c5d47-0245-48ef-a45f-0467a776967e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:32.437080 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-561c5d47-0245-48ef-a45f-0467a776967e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:48:32.444433 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-561c5d47-0245-48ef-a45f-0467a776967e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1565 microversion: 2.1 time: 0.175390 May 23 16:48:32.445003 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 147/305] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:48:32 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:48:32.461499 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-174b63cc-9bd8-463c-b008-c79ce1da02b3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:48:32.461999 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-174b63cc-9bd8-463c-b008-c79ce1da02b3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:48:32.468597 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-174b63cc-9bd8-463c-b008-c79ce1da02b3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:32.469053 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-174b63cc-9bd8-463c-b008-c79ce1da02b3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:32.469810 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-174b63cc-9bd8-463c-b008-c79ce1da02b3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:32.470248 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-174b63cc-9bd8-463c-b008-c79ce1da02b3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:32.544492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-174b63cc-9bd8-463c-b008-c79ce1da02b3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086731 May 23 16:48:32.545212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 159/306] 10.222.0.74 () {58 vars in 1274 bytes} [Mon May 23 16:48:32 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:48:33.506826 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-40244c51-a744-4b64-ac54-64c8cb6d02e6 req-77577db7-7a64-4c2a-9a41-c736a961f55e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a3c1df-8e11-4485-a5ef-fa843b4362d3", "tag": "e00c55e6-6b89-4971-bceb-0a87e0ee6987"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:48:33.516239 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-40244c51-a744-4b64-ac54-64c8cb6d02e6 req-77577db7-7a64-4c2a-9a41-c736a961f55e service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:48:33.516835 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-40244c51-a744-4b64-ac54-64c8cb6d02e6 req-77577db7-7a64-4c2a-9a41-c736a961f55e service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:48:33.527657 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-40244c51-a744-4b64-ac54-64c8cb6d02e6 req-77577db7-7a64-4c2a-9a41-c736a961f55e service nova] Creating event network-changed:e00c55e6-6b89-4971-bceb-0a87e0ee6987 for instance 14a3c1df-8e11-4485-a5ef-fa843b4362d3 on hv-cinder-83925 May 23 16:48:33.533026 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-40244c51-a744-4b64-ac54-64c8cb6d02e6 req-77577db7-7a64-4c2a-9a41-c736a961f55e service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029814 May 23 16:48:33.533623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 148/307] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:49:05.037115 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=9 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:05.037874 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=65 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:05.041806 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-daf107f6-7c59-40a0-af5e-ac39dde14a0d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Action: 'create', calling method: .version_select at 0x7f224c784ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-986069349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvuQpk6eRSqr59DjZrKVXpApeoKxXrrlyYCfagyy6QIyctc02cnv8WOty/fgG+vOW0by1YyfAn4synP+zSYn/wFwZC/hrf+IQhIQa8Yb6kWDkP17VmvrZMR1WAcdUEy5Q=="}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:49:05.055966 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-daf107f6-7c59-40a0-af5e-ac39dde14a0d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Getting quotas for project 74aa5dda63754f62b71d74fcaa4bee01. Resources: {'key_pairs'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:49:05.059633 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-daf107f6-7c59-40a0-af5e-ac39dde14a0d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Getting quotas for user 3d8a088405d549cda80615fd41a661c0 and project 74aa5dda63754f62b71d74fcaa4bee01. Resources: {'key_pairs'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:49:05.070957 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR oslo.messaging._drivers.impl_rabbit [None req-daf107f6-7c59-40a0-af5e-ac39dde14a0d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [b42765ad-0db8-410e-b215-3a67565677d5] AMQP server on 10.222.0.74:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 23 16:49:06.087090 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO oslo.messaging._drivers.impl_rabbit [None req-daf107f6-7c59-40a0-af5e-ac39dde14a0d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [b42765ad-0db8-410e-b215-3a67565677d5] Reconnected to AMQP server on 10.222.0.74:5672 via [amqp] client with port 46262. May 23 16:49:06.199766 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-daf107f6-7c59-40a0-af5e-ac39dde14a0d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.163638 May 23 16:49:06.200416 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 160/308] 10.222.0.74 () {60 vars in 1158 bytes} [Mon May 23 16:49:05 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:49:06.250470 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-2c3136d8-19fb-4238-b810-3a6988e98444 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1659874065", "imageRef": "25a372cf-4935-47f7-bf94-a5062985a584", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-986069349", "networks": [{"uuid": "4458271a-2b00-419d-8105-b2bb6fc6760c"}]}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:49:06.257475 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=5 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:06.258152 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=61 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:06.304466 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.network.neutron [None req-2c3136d8-19fb-4238-b810-3a6988e98444 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] validate_networks() for [('4458271a-2b00-419d-8105-b2bb6fc6760c', None, None, None, None, None)] {{(pid=124714) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 16:49:06.364403 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-4f388658-c86b-40d5-b315-89f735974eb4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:06.364925 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-4f388658-c86b-40d5-b315-89f735974eb4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:06.371208 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4f388658-c86b-40d5-b315-89f735974eb4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:06.371656 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4f388658-c86b-40d5-b315-89f735974eb4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:06.372441 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4f388658-c86b-40d5-b315-89f735974eb4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:06.372971 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4f388658-c86b-40d5-b315-89f735974eb4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:06.397304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-4f388658-c86b-40d5-b315-89f735974eb4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c/ips" status: 200 len: 151 microversion: 2.1 time: 0.036912 May 23 16:49:06.398044 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 161/309] 10.222.0.74 () {58 vars in 1247 bytes} [Mon May 23 16:49:06 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:49:06.675606 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-2c3136d8-19fb-4238-b810-3a6988e98444 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Flavor limits 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 16:49:06.676032 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-2c3136d8-19fb-4238-b810-3a6988e98444 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Image limits 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 16:49:06.676624 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-2c3136d8-19fb-4238-b810-3a6988e98444 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Flavor pref 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 16:49:06.677032 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-2c3136d8-19fb-4238-b810-3a6988e98444 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Image pref 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 16:49:06.677441 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-2c3136d8-19fb-4238-b810-3a6988e98444 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 16:49:06.686342 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2c3136d8-19fb-4238-b810-3a6988e98444 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:06.687323 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2c3136d8-19fb-4238-b810-3a6988e98444 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:06.688270 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2c3136d8-19fb-4238-b810-3a6988e98444 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:06.688749 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2c3136d8-19fb-4238-b810-3a6988e98444 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:06.706586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-2c3136d8-19fb-4238-b810-3a6988e98444 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Getting quotas for project 74aa5dda63754f62b71d74fcaa4bee01. Resources: {'cores', 'instances', 'ram'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:49:06.711124 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-2c3136d8-19fb-4238-b810-3a6988e98444 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Getting quotas for user 3d8a088405d549cda80615fd41a661c0 and project 74aa5dda63754f62b71d74fcaa4bee01. Resources: {'cores', 'instances', 'ram'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:49:06.722195 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-2c3136d8-19fb-4238-b810-3a6988e98444 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Going to run 1 instances... {{(pid=124714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 16:49:06.724582 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-2c3136d8-19fb-4238-b810-3a6988e98444 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25a372cf-4935-47f7-bf94-a5062985a584',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 16:49:06.879468 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2c3136d8-19fb-4238-b810-3a6988e98444 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [7335eb60-4521-443a-a1b5-4a044088d126] AMQP server on 10.222.0.74:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 23 16:49:07.887334 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO oslo.messaging._drivers.impl_rabbit [None req-2c3136d8-19fb-4238-b810-3a6988e98444 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [7335eb60-4521-443a-a1b5-4a044088d126] Reconnected to AMQP server on 10.222.0.74:5672 via [amqp] client with port 46298. May 23 16:49:07.892570 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-2c3136d8-19fb-4238-b810-3a6988e98444 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.646737 May 23 16:49:07.899322 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 149/310] 10.222.0.74 () {60 vars in 1146 bytes} [Mon May 23 16:49:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 16:49:07.911921 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-4b7f7262-7848-4a15-aaee-33a1927ab1ad tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:07.912583 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-4b7f7262-7848-4a15-aaee-33a1927ab1ad tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:07.965392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-4b7f7262-7848-4a15-aaee-33a1927ab1ad tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:07.972168 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-4b7f7262-7848-4a15-aaee-33a1927ab1ad tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1258 microversion: 2.1 time: 0.068043 May 23 16:49:07.972760 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 162/311] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:07 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:08.990491 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-c2419e37-87fe-4ee7-a961-4908e2fb3fa0 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:08.991108 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-c2419e37-87fe-4ee7-a961-4908e2fb3fa0 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:09.048833 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-c2419e37-87fe-4ee7-a961-4908e2fb3fa0 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:09.055700 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-c2419e37-87fe-4ee7-a961-4908e2fb3fa0 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1258 microversion: 2.1 time: 0.070062 May 23 16:49:09.056449 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 150/312] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:08 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:09.159479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e66bfa31-6e26-4fd2-98ca-332d79e4de15 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7417567b-3164-4149-8f79-7b61459536f3"}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:49:09.160575 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e66bfa31-6e26-4fd2-98ca-332d79e4de15 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:09.167217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e66bfa31-6e26-4fd2-98ca-332d79e4de15 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:09.167717 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e66bfa31-6e26-4fd2-98ca-332d79e4de15 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:09.168531 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e66bfa31-6e26-4fd2-98ca-332d79e4de15 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:09.168974 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e66bfa31-6e26-4fd2-98ca-332d79e4de15 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:09.989600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e66bfa31-6e26-4fd2-98ca-332d79e4de15 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "POST /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.834878 May 23 16:49:09.990259 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 163/313] 10.222.0.74 () {60 vars in 1322 bytes} [Mon May 23 16:49:09 2022] POST /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c/os-volume_attachments => generated 194 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:49:10.072482 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-6b87ad91-9db7-447e-88f8-552d900e2174 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:10.073090 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-6b87ad91-9db7-447e-88f8-552d900e2174 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:10.146150 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-6b87ad91-9db7-447e-88f8-552d900e2174 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:10.153275 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-6b87ad91-9db7-447e-88f8-552d900e2174 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1258 microversion: 2.1 time: 0.084625 May 23 16:49:10.153851 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 151/314] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:10 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1258 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:11.171905 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-090675ff-9ac2-4810-9a37-c3c879f2c263 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:11.172994 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-090675ff-9ac2-4810-9a37-c3c879f2c263 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:11.179474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-090675ff-9ac2-4810-9a37-c3c879f2c263 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:11.179932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-090675ff-9ac2-4810-9a37-c3c879f2c263 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:11.180739 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-090675ff-9ac2-4810-9a37-c3c879f2c263 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:11.181179 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-090675ff-9ac2-4810-9a37-c3c879f2c263 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:11.243241 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-090675ff-9ac2-4810-9a37-c3c879f2c263 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:11.250768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-090675ff-9ac2-4810-9a37-c3c879f2c263 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1262 microversion: 2.1 time: 0.083528 May 23 16:49:11.251386 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 164/315] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:11 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:12.267416 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-9eb4a31f-7144-436c-ab85-1d40d87c9ee3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:12.268039 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-9eb4a31f-7144-436c-ab85-1d40d87c9ee3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:12.277836 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9eb4a31f-7144-436c-ab85-1d40d87c9ee3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:12.278295 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9eb4a31f-7144-436c-ab85-1d40d87c9ee3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:12.279078 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9eb4a31f-7144-436c-ab85-1d40d87c9ee3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:12.279724 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9eb4a31f-7144-436c-ab85-1d40d87c9ee3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:12.343918 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-9eb4a31f-7144-436c-ab85-1d40d87c9ee3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:12.352089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-9eb4a31f-7144-436c-ab85-1d40d87c9ee3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1310 microversion: 2.1 time: 0.088552 May 23 16:49:12.352743 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 152/316] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:12 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1310 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:13.369618 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-2cbcb3ab-5517-4ae0-a7dd-3516816273eb tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:13.370318 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-2cbcb3ab-5517-4ae0-a7dd-3516816273eb tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:13.377325 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2cbcb3ab-5517-4ae0-a7dd-3516816273eb tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:13.377862 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2cbcb3ab-5517-4ae0-a7dd-3516816273eb tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:13.379396 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2cbcb3ab-5517-4ae0-a7dd-3516816273eb tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:13.379897 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2cbcb3ab-5517-4ae0-a7dd-3516816273eb tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:13.518593 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-2cbcb3ab-5517-4ae0-a7dd-3516816273eb tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:13.527433 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-2cbcb3ab-5517-4ae0-a7dd-3516816273eb tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.161824 May 23 16:49:13.528006 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 165/317] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:13 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:14.357541 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-4e13fe7a-d1f3-4a63-bfc1-bf4ec17851e6 req-81ca5f7b-d9ac-4fdd-bb2c-e53c106dfe3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e337be75-f64c-4c86-97f1-e31cf55a6089", "tag": "5141686c-093d-45da-8646-a43dcece1e63"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:49:14.365823 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-4e13fe7a-d1f3-4a63-bfc1-bf4ec17851e6 req-81ca5f7b-d9ac-4fdd-bb2c-e53c106dfe3f service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:14.366302 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-4e13fe7a-d1f3-4a63-bfc1-bf4ec17851e6 req-81ca5f7b-d9ac-4fdd-bb2c-e53c106dfe3f service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:14.378968 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-4e13fe7a-d1f3-4a63-bfc1-bf4ec17851e6 req-81ca5f7b-d9ac-4fdd-bb2c-e53c106dfe3f service nova] Creating event network-changed:5141686c-093d-45da-8646-a43dcece1e63 for instance e337be75-f64c-4c86-97f1-e31cf55a6089 on hv-cinder-83925 May 23 16:49:14.384571 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-4e13fe7a-d1f3-4a63-bfc1-bf4ec17851e6 req-81ca5f7b-d9ac-4fdd-bb2c-e53c106dfe3f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033296 May 23 16:49:14.385109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 153/318] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:49:14.544670 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-47fb2eaf-6142-4297-86e7-d3dce9efa0da tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:14.545359 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-47fb2eaf-6142-4297-86e7-d3dce9efa0da tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:14.552134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-47fb2eaf-6142-4297-86e7-d3dce9efa0da tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:14.552692 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-47fb2eaf-6142-4297-86e7-d3dce9efa0da tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:14.553528 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-47fb2eaf-6142-4297-86e7-d3dce9efa0da tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:14.554068 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-47fb2eaf-6142-4297-86e7-d3dce9efa0da tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:14.710980 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-47fb2eaf-6142-4297-86e7-d3dce9efa0da tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:14.719155 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-47fb2eaf-6142-4297-86e7-d3dce9efa0da tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.178316 May 23 16:49:14.719805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 166/319] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:14 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:15.738226 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-3d82e72a-252b-4428-a4cd-649c45e9a6bd tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:15.738226 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-3d82e72a-252b-4428-a4cd-649c45e9a6bd tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:15.744885 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3d82e72a-252b-4428-a4cd-649c45e9a6bd tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:15.745385 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3d82e72a-252b-4428-a4cd-649c45e9a6bd tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:15.746178 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3d82e72a-252b-4428-a4cd-649c45e9a6bd tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:15.746623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3d82e72a-252b-4428-a4cd-649c45e9a6bd tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:15.879185 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-3d82e72a-252b-4428-a4cd-649c45e9a6bd tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:15.889657 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-3d82e72a-252b-4428-a4cd-649c45e9a6bd tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.156973 May 23 16:49:15.890242 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 154/320] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:15 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:16.906855 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e3f6890e-7107-4d1a-8009-6265305542bb tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:16.907387 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e3f6890e-7107-4d1a-8009-6265305542bb tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:16.913935 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e3f6890e-7107-4d1a-8009-6265305542bb tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:16.914887 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e3f6890e-7107-4d1a-8009-6265305542bb tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:16.915649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e3f6890e-7107-4d1a-8009-6265305542bb tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:16.916084 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e3f6890e-7107-4d1a-8009-6265305542bb tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:17.044673 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e3f6890e-7107-4d1a-8009-6265305542bb tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:17.053744 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e3f6890e-7107-4d1a-8009-6265305542bb tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.150713 May 23 16:49:17.063409 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 167/321] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:16 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:17.619433 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ca7231ca-ad66-4089-8923-984c86584ba3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:17.620044 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ca7231ca-ad66-4089-8923-984c86584ba3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:17.622015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=2 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:17.627648 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ca7231ca-ad66-4089-8923-984c86584ba3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:17.628098 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ca7231ca-ad66-4089-8923-984c86584ba3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:17.628899 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ca7231ca-ad66-4089-8923-984c86584ba3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:17.629332 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ca7231ca-ad66-4089-8923-984c86584ba3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:17.656894 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ca7231ca-ad66-4089-8923-984c86584ba3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357/ips" status: 200 len: 152 microversion: 2.20 time: 0.041709 May 23 16:49:17.657723 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 155/322] 10.222.0.74 () {60 vars in 1288 bytes} [Mon May 23 16:49:17 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 16:49:18.072283 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-514489cb-e5af-487a-88f9-a0638eeff639 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:18.073607 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-514489cb-e5af-487a-88f9-a0638eeff639 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:18.078690 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=6 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:18.082744 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-514489cb-e5af-487a-88f9-a0638eeff639 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:18.083262 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-514489cb-e5af-487a-88f9-a0638eeff639 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:18.084103 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-514489cb-e5af-487a-88f9-a0638eeff639 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:18.084637 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-514489cb-e5af-487a-88f9-a0638eeff639 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:18.219454 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-514489cb-e5af-487a-88f9-a0638eeff639 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:18.227723 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-514489cb-e5af-487a-88f9-a0638eeff639 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.160172 May 23 16:49:18.228277 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 168/323] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:18 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:19.252218 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-169592f8-93e8-423a-9ca1-0b78212165ca tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:19.252893 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-169592f8-93e8-423a-9ca1-0b78212165ca tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:19.260981 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-169592f8-93e8-423a-9ca1-0b78212165ca tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:19.261445 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-169592f8-93e8-423a-9ca1-0b78212165ca tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:19.262215 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-169592f8-93e8-423a-9ca1-0b78212165ca tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:19.262657 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-169592f8-93e8-423a-9ca1-0b78212165ca tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:19.391205 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-169592f8-93e8-423a-9ca1-0b78212165ca tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:19.398715 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-169592f8-93e8-423a-9ca1-0b78212165ca tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.150408 May 23 16:49:19.399369 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 156/324] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:19 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:20.416355 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-0267029c-abd8-48bf-86d5-1ccaac28f26a tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:20.417641 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-0267029c-abd8-48bf-86d5-1ccaac28f26a tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:20.424165 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0267029c-abd8-48bf-86d5-1ccaac28f26a tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:20.424844 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0267029c-abd8-48bf-86d5-1ccaac28f26a tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:20.425820 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0267029c-abd8-48bf-86d5-1ccaac28f26a tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:20.426421 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0267029c-abd8-48bf-86d5-1ccaac28f26a tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:20.563814 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-0267029c-abd8-48bf-86d5-1ccaac28f26a tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:20.572853 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-0267029c-abd8-48bf-86d5-1ccaac28f26a tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.161256 May 23 16:49:20.573664 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 169/325] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:20 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:21.596145 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-f8af3fbb-c4e4-4cf9-bfb5-082ba77719c4 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:21.597100 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-f8af3fbb-c4e4-4cf9-bfb5-082ba77719c4 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:21.599078 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=10 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:21.607166 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f8af3fbb-c4e4-4cf9-bfb5-082ba77719c4 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:21.607443 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f8af3fbb-c4e4-4cf9-bfb5-082ba77719c4 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:21.608401 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f8af3fbb-c4e4-4cf9-bfb5-082ba77719c4 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:21.608851 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f8af3fbb-c4e4-4cf9-bfb5-082ba77719c4 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:21.769135 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-f8af3fbb-c4e4-4cf9-bfb5-082ba77719c4 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:21.777298 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-f8af3fbb-c4e4-4cf9-bfb5-082ba77719c4 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.190754 May 23 16:49:21.777860 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 157/326] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:21 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:22.044364 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-f25472ff-6c80-4dd3-b880-585c6942eae8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:49:22.044988 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-f25472ff-6c80-4dd3-b880-585c6942eae8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:22.051350 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f25472ff-6c80-4dd3-b880-585c6942eae8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:22.051806 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f25472ff-6c80-4dd3-b880-585c6942eae8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:22.052611 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f25472ff-6c80-4dd3-b880-585c6942eae8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:22.053056 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f25472ff-6c80-4dd3-b880-585c6942eae8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:22.075615 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.objects.instance [None req-f25472ff-6c80-4dd3-b880-585c6942eae8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lazy-loading 'flavor' on Instance uuid bb302c29-c30d-4ffa-af9d-1f226fd56357 {{(pid=124715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:49:22.615843 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-f25472ff-6c80-4dd3-b880-585c6942eae8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "POST /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357/action" status: 202 len: 0 microversion: 2.20 time: 0.569231 May 23 16:49:22.615843 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 170/327] 10.222.0.74 () {62 vars in 1318 bytes} [Mon May 23 16:49:22 2022] POST /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 16:49:22.618990 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-c2769efd-1116-462e-9143-7e49dc8e7756 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:22.619588 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-c2769efd-1116-462e-9143-7e49dc8e7756 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:22.626137 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c2769efd-1116-462e-9143-7e49dc8e7756 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:22.626596 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c2769efd-1116-462e-9143-7e49dc8e7756 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:22.627366 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c2769efd-1116-462e-9143-7e49dc8e7756 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:22.627809 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c2769efd-1116-462e-9143-7e49dc8e7756 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:22.764950 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-c2769efd-1116-462e-9143-7e49dc8e7756 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:22.783193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-c2769efd-1116-462e-9143-7e49dc8e7756 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:22.784814 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-c2769efd-1116-462e-9143-7e49dc8e7756 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:22.786310 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-c2769efd-1116-462e-9143-7e49dc8e7756 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1724 microversion: 2.20 time: 0.171551 May 23 16:49:22.796957 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 158/328] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:22 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:22.801704 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-504f1aa5-a4c7-49bf-9638-483abcaa147f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:22.802570 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-504f1aa5-a4c7-49bf-9638-483abcaa147f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:22.810180 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-504f1aa5-a4c7-49bf-9638-483abcaa147f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:22.810643 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-504f1aa5-a4c7-49bf-9638-483abcaa147f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:22.811591 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-504f1aa5-a4c7-49bf-9638-483abcaa147f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:22.812041 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-504f1aa5-a4c7-49bf-9638-483abcaa147f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:22.959197 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-504f1aa5-a4c7-49bf-9638-483abcaa147f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:22.967890 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-504f1aa5-a4c7-49bf-9638-483abcaa147f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.171210 May 23 16:49:22.968538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 171/329] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:22 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:23.806962 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-84d84737-48ef-436b-b7e3-f7f9dd0feae9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:23.807618 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-84d84737-48ef-436b-b7e3-f7f9dd0feae9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:23.815478 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-84d84737-48ef-436b-b7e3-f7f9dd0feae9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:23.816609 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-84d84737-48ef-436b-b7e3-f7f9dd0feae9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:23.817603 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-84d84737-48ef-436b-b7e3-f7f9dd0feae9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:23.818378 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-84d84737-48ef-436b-b7e3-f7f9dd0feae9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:23.959186 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-84d84737-48ef-436b-b7e3-f7f9dd0feae9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:23.968140 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-84d84737-48ef-436b-b7e3-f7f9dd0feae9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:23.969709 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-84d84737-48ef-436b-b7e3-f7f9dd0feae9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:23.970867 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-84d84737-48ef-436b-b7e3-f7f9dd0feae9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1724 microversion: 2.20 time: 0.169230 May 23 16:49:23.971421 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 159/330] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:23 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:23.983856 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-11c642f6-44bf-454f-93ef-8d30941ad92f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:23.984508 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-11c642f6-44bf-454f-93ef-8d30941ad92f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:23.991194 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-11c642f6-44bf-454f-93ef-8d30941ad92f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:23.991637 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-11c642f6-44bf-454f-93ef-8d30941ad92f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:23.992486 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-11c642f6-44bf-454f-93ef-8d30941ad92f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:23.992971 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-11c642f6-44bf-454f-93ef-8d30941ad92f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:24.119494 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-11c642f6-44bf-454f-93ef-8d30941ad92f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:24.126845 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-11c642f6-44bf-454f-93ef-8d30941ad92f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.146807 May 23 16:49:24.127413 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 172/331] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:23 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:24.990355 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-6967f30d-8a76-4501-b3ad-77db24d78018 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:24.990998 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-6967f30d-8a76-4501-b3ad-77db24d78018 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:24.998041 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6967f30d-8a76-4501-b3ad-77db24d78018 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:24.998482 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6967f30d-8a76-4501-b3ad-77db24d78018 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:24.999233 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6967f30d-8a76-4501-b3ad-77db24d78018 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:24.999667 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6967f30d-8a76-4501-b3ad-77db24d78018 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:25.143341 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-d0997376-b4e4-413a-8a49-9614c44188bf tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:25.143876 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-6967f30d-8a76-4501-b3ad-77db24d78018 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:25.144175 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-d0997376-b4e4-413a-8a49-9614c44188bf tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:25.151355 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d0997376-b4e4-413a-8a49-9614c44188bf tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:25.151815 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d0997376-b4e4-413a-8a49-9614c44188bf tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:25.152681 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d0997376-b4e4-413a-8a49-9614c44188bf tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:25.153128 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d0997376-b4e4-413a-8a49-9614c44188bf tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:25.154238 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-6967f30d-8a76-4501-b3ad-77db24d78018 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:25.155940 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-6967f30d-8a76-4501-b3ad-77db24d78018 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:25.158516 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-6967f30d-8a76-4501-b3ad-77db24d78018 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1724 microversion: 2.20 time: 0.170812 May 23 16:49:25.170505 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 160/332] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:24 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:25.305897 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d0997376-b4e4-413a-8a49-9614c44188bf tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:25.313254 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-d0997376-b4e4-413a-8a49-9614c44188bf tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.173807 May 23 16:49:25.314094 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 173/333] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:25 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:49:26.177102 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-47ed6647-bdd3-46e9-896c-1cc009f362e8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:26.177664 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-47ed6647-bdd3-46e9-896c-1cc009f362e8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:26.184774 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-47ed6647-bdd3-46e9-896c-1cc009f362e8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:26.185242 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-47ed6647-bdd3-46e9-896c-1cc009f362e8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:26.186011 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-47ed6647-bdd3-46e9-896c-1cc009f362e8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:26.186454 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-47ed6647-bdd3-46e9-896c-1cc009f362e8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:26.314179 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-47ed6647-bdd3-46e9-896c-1cc009f362e8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:26.323666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-47ed6647-bdd3-46e9-896c-1cc009f362e8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:26.325252 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-47ed6647-bdd3-46e9-896c-1cc009f362e8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:26.326450 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-47ed6647-bdd3-46e9-896c-1cc009f362e8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1724 microversion: 2.20 time: 0.153318 May 23 16:49:26.327013 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 161/334] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:26 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:26.330960 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-6a404858-57ba-4b21-b9c7-94e7a171a277 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:26.331719 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-6a404858-57ba-4b21-b9c7-94e7a171a277 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:26.339318 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a404858-57ba-4b21-b9c7-94e7a171a277 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:26.339764 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a404858-57ba-4b21-b9c7-94e7a171a277 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:26.340575 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a404858-57ba-4b21-b9c7-94e7a171a277 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:26.341144 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a404858-57ba-4b21-b9c7-94e7a171a277 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:26.494179 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-6a404858-57ba-4b21-b9c7-94e7a171a277 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:26.501749 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-6a404858-57ba-4b21-b9c7-94e7a171a277 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.174793 May 23 16:49:26.502316 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 174/335] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:26 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:49:27.344815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-8d471729-d058-4c21-b14d-747d562a0f76 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:27.345440 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-8d471729-d058-4c21-b14d-747d562a0f76 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:27.351803 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8d471729-d058-4c21-b14d-747d562a0f76 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:27.352245 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8d471729-d058-4c21-b14d-747d562a0f76 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:27.353067 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8d471729-d058-4c21-b14d-747d562a0f76 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:27.353507 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8d471729-d058-4c21-b14d-747d562a0f76 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:27.485372 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8d471729-d058-4c21-b14d-747d562a0f76 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:27.493190 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8d471729-d058-4c21-b14d-747d562a0f76 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:27.495193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8d471729-d058-4c21-b14d-747d562a0f76 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:27.496364 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-8d471729-d058-4c21-b14d-747d562a0f76 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1724 microversion: 2.20 time: 0.155416 May 23 16:49:27.496922 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 162/336] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:27 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:27.518726 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-8c232d10-996a-48ed-bbb2-085d2ba080c4 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:27.519341 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-8c232d10-996a-48ed-bbb2-085d2ba080c4 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:27.526483 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8c232d10-996a-48ed-bbb2-085d2ba080c4 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:27.526934 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8c232d10-996a-48ed-bbb2-085d2ba080c4 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:27.527710 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8c232d10-996a-48ed-bbb2-085d2ba080c4 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:27.528147 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8c232d10-996a-48ed-bbb2-085d2ba080c4 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:27.547122 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:27.664923 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-8c232d10-996a-48ed-bbb2-085d2ba080c4 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:27.670525 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-8c232d10-996a-48ed-bbb2-085d2ba080c4 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.155571 May 23 16:49:27.671196 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 175/337] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:27 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:28.515040 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-83bae2cd-3235-4f50-9d12-1ebe4bffc065 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:28.515659 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-83bae2cd-3235-4f50-9d12-1ebe4bffc065 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:28.522195 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-83bae2cd-3235-4f50-9d12-1ebe4bffc065 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:28.522635 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-83bae2cd-3235-4f50-9d12-1ebe4bffc065 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:28.523405 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-83bae2cd-3235-4f50-9d12-1ebe4bffc065 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:28.523885 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-83bae2cd-3235-4f50-9d12-1ebe4bffc065 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:28.658642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-83bae2cd-3235-4f50-9d12-1ebe4bffc065 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:28.666583 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-83bae2cd-3235-4f50-9d12-1ebe4bffc065 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:28.668079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-83bae2cd-3235-4f50-9d12-1ebe4bffc065 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:28.669506 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-83bae2cd-3235-4f50-9d12-1ebe4bffc065 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1724 microversion: 2.20 time: 0.158316 May 23 16:49:28.670046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 163/338] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:28 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:28.687645 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-9249b8c8-b983-46b2-9a6d-ad0968aee562 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:28.688236 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-9249b8c8-b983-46b2-9a6d-ad0968aee562 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:28.695322 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9249b8c8-b983-46b2-9a6d-ad0968aee562 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:28.695782 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9249b8c8-b983-46b2-9a6d-ad0968aee562 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:28.696635 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9249b8c8-b983-46b2-9a6d-ad0968aee562 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:28.698000 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9249b8c8-b983-46b2-9a6d-ad0968aee562 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:28.824256 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-9249b8c8-b983-46b2-9a6d-ad0968aee562 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:28.831728 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-9249b8c8-b983-46b2-9a6d-ad0968aee562 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.147973 May 23 16:49:28.832313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 176/339] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:28 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:29.687709 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-5a83932f-8861-4d10-8179-8d2ea1db349d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:29.688343 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-5a83932f-8861-4d10-8179-8d2ea1db349d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:29.694781 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-5a83932f-8861-4d10-8179-8d2ea1db349d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:29.695226 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-5a83932f-8861-4d10-8179-8d2ea1db349d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:29.695978 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-5a83932f-8861-4d10-8179-8d2ea1db349d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:29.696436 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-5a83932f-8861-4d10-8179-8d2ea1db349d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:29.825174 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-5a83932f-8861-4d10-8179-8d2ea1db349d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:29.833385 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-5a83932f-8861-4d10-8179-8d2ea1db349d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:29.834884 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-5a83932f-8861-4d10-8179-8d2ea1db349d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:29.836028 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-5a83932f-8861-4d10-8179-8d2ea1db349d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1724 microversion: 2.20 time: 0.152298 May 23 16:49:29.836623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 164/340] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:29 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:29.849179 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-14926e99-0455-4637-87f3-1951001b58fd tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:29.849789 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-14926e99-0455-4637-87f3-1951001b58fd tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:29.857650 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-14926e99-0455-4637-87f3-1951001b58fd tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:29.858097 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-14926e99-0455-4637-87f3-1951001b58fd tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:29.859259 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-14926e99-0455-4637-87f3-1951001b58fd tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:29.859694 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-14926e99-0455-4637-87f3-1951001b58fd tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:29.999951 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-14926e99-0455-4637-87f3-1951001b58fd tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:30.007532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-14926e99-0455-4637-87f3-1951001b58fd tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.162508 May 23 16:49:30.008101 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 177/341] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:29 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:30.855275 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-9fc831b5-d609-47a5-97bb-0e7ba544f834 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:30.855883 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-9fc831b5-d609-47a5-97bb-0e7ba544f834 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:30.862139 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9fc831b5-d609-47a5-97bb-0e7ba544f834 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:30.862598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9fc831b5-d609-47a5-97bb-0e7ba544f834 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:30.863417 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9fc831b5-d609-47a5-97bb-0e7ba544f834 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:30.863861 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9fc831b5-d609-47a5-97bb-0e7ba544f834 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:30.992140 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-9fc831b5-d609-47a5-97bb-0e7ba544f834 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:31.000617 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-9fc831b5-d609-47a5-97bb-0e7ba544f834 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:31.002134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-9fc831b5-d609-47a5-97bb-0e7ba544f834 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:31.003288 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-9fc831b5-d609-47a5-97bb-0e7ba544f834 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1724 microversion: 2.20 time: 0.152456 May 23 16:49:31.003844 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 165/342] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:30 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:31.024339 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-1bc9721d-c003-471f-a671-d00c2a8ca78b tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:31.024960 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-1bc9721d-c003-471f-a671-d00c2a8ca78b tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:31.031475 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1bc9721d-c003-471f-a671-d00c2a8ca78b tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:31.031942 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1bc9721d-c003-471f-a671-d00c2a8ca78b tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:31.032710 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1bc9721d-c003-471f-a671-d00c2a8ca78b tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:31.033146 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1bc9721d-c003-471f-a671-d00c2a8ca78b tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:31.162752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-1bc9721d-c003-471f-a671-d00c2a8ca78b tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:31.170969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-1bc9721d-c003-471f-a671-d00c2a8ca78b tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.150572 May 23 16:49:31.171659 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 178/343] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:31 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:31.296445 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-6fb5a401-486e-4380-8a78-40d5108c6cf4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Action: 'create', calling method: .version_select at 0x7f224c633f70>, body: {"keypair": {"name": "tempest-keypair-120995086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2U+YH+WtPzz6cobWraW8BIZQPw1WDV8Ru1bw9JivdGFtx3OhQEyOLB+yKIcc588eU1TIo6jZzZC0df/HJHW8gLofsYrM03qHhT5TJ+gtYa20gbu/G0jR6G7BSfZPXemg=="}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:49:31.310555 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-6fb5a401-486e-4380-8a78-40d5108c6cf4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Getting quotas for project e293f2b3de9143ad9e8a1fe8b67d6641. Resources: {'key_pairs'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:49:31.314347 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-6fb5a401-486e-4380-8a78-40d5108c6cf4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Getting quotas for user 718a82d2f4294f68965ce01aac0fc166 and project e293f2b3de9143ad9e8a1fe8b67d6641. Resources: {'key_pairs'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:49:31.400074 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-6fb5a401-486e-4380-8a78-40d5108c6cf4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.108103 May 23 16:49:31.400818 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 166/344] 10.222.0.74 () {60 vars in 1158 bytes} [Mon May 23 16:49:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:49:32.021578 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-d354642f-f277-4b06-829c-f74ca4067996 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:32.022229 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-d354642f-f277-4b06-829c-f74ca4067996 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:32.029291 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d354642f-f277-4b06-829c-f74ca4067996 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:32.029875 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d354642f-f277-4b06-829c-f74ca4067996 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:32.030494 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d354642f-f277-4b06-829c-f74ca4067996 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:32.030939 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d354642f-f277-4b06-829c-f74ca4067996 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:32.161995 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d354642f-f277-4b06-829c-f74ca4067996 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:32.170557 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d354642f-f277-4b06-829c-f74ca4067996 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:32.172075 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d354642f-f277-4b06-829c-f74ca4067996 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:32.173310 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-d354642f-f277-4b06-829c-f74ca4067996 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1724 microversion: 2.20 time: 0.155685 May 23 16:49:32.173923 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 179/345] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:32 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:32.188355 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-b34793b4-ec13-4d97-ab64-bac1c264bc56 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:32.188983 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-b34793b4-ec13-4d97-ab64-bac1c264bc56 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:32.195030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b34793b4-ec13-4d97-ab64-bac1c264bc56 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:32.195470 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b34793b4-ec13-4d97-ab64-bac1c264bc56 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:32.196370 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b34793b4-ec13-4d97-ab64-bac1c264bc56 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:32.196813 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b34793b4-ec13-4d97-ab64-bac1c264bc56 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:32.330885 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b34793b4-ec13-4d97-ab64-bac1c264bc56 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:32.338717 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-b34793b4-ec13-4d97-ab64-bac1c264bc56 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.155627 May 23 16:49:32.339277 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 167/346] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:32 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:33.195458 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-bef7516b-1d18-4174-a9f8-3ddfa42dd64e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:33.195458 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-bef7516b-1d18-4174-a9f8-3ddfa42dd64e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:33.201013 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bef7516b-1d18-4174-a9f8-3ddfa42dd64e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:33.201472 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bef7516b-1d18-4174-a9f8-3ddfa42dd64e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:33.202282 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bef7516b-1d18-4174-a9f8-3ddfa42dd64e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:33.202725 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bef7516b-1d18-4174-a9f8-3ddfa42dd64e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:33.331534 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-bef7516b-1d18-4174-a9f8-3ddfa42dd64e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:33.340078 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-bef7516b-1d18-4174-a9f8-3ddfa42dd64e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:33.342233 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-bef7516b-1d18-4174-a9f8-3ddfa42dd64e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:33.343403 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-bef7516b-1d18-4174-a9f8-3ddfa42dd64e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1724 microversion: 2.20 time: 0.154921 May 23 16:49:33.343965 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 180/347] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:33 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:33.354787 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-37312764-49f0-476c-9caa-200425ff3de3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:33.355540 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-37312764-49f0-476c-9caa-200425ff3de3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:33.362970 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-37312764-49f0-476c-9caa-200425ff3de3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:33.363427 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-37312764-49f0-476c-9caa-200425ff3de3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:33.364198 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-37312764-49f0-476c-9caa-200425ff3de3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:33.364662 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-37312764-49f0-476c-9caa-200425ff3de3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:33.495084 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-37312764-49f0-476c-9caa-200425ff3de3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:33.503598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-37312764-49f0-476c-9caa-200425ff3de3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.152563 May 23 16:49:33.504171 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 168/348] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:33 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:33.788728 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-5d645725-90f5-4d00-aadc-068b5afc5720 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-775450702", "imageRef": "96972e76-879d-4149-a713-a94529892aad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18a683c4-5441-4a3c-96d0-ecf1b626575e"}], "security_groups": [{"name": "tempest-securitygroup--1378372522"}], "key_name": "tempest-keypair-120995086", "user_data": "}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:49:33.892776 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.network.neutron [None req-5d645725-90f5-4d00-aadc-068b5afc5720 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] validate_networks() for [('18a683c4-5441-4a3c-96d0-ecf1b626575e', None, None, None, None, None)] {{(pid=124715) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 16:49:34.362176 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-a930bd8f-d0f0-4340-8ee9-a1e831297ae5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:34.363470 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-a930bd8f-d0f0-4340-8ee9-a1e831297ae5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:34.369964 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a930bd8f-d0f0-4340-8ee9-a1e831297ae5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:34.370409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a930bd8f-d0f0-4340-8ee9-a1e831297ae5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:34.371184 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a930bd8f-d0f0-4340-8ee9-a1e831297ae5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:34.371627 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a930bd8f-d0f0-4340-8ee9-a1e831297ae5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:34.540649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-5d645725-90f5-4d00-aadc-068b5afc5720 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Flavor limits 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 16:49:34.541203 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-5d645725-90f5-4d00-aadc-068b5afc5720 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Image limits 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 16:49:34.541546 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-5d645725-90f5-4d00-aadc-068b5afc5720 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Flavor pref 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 16:49:34.541962 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-5d645725-90f5-4d00-aadc-068b5afc5720 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Image pref 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 16:49:34.542380 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-5d645725-90f5-4d00-aadc-068b5afc5720 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 16:49:34.551877 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5d645725-90f5-4d00-aadc-068b5afc5720 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:34.552358 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5d645725-90f5-4d00-aadc-068b5afc5720 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:34.553165 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5d645725-90f5-4d00-aadc-068b5afc5720 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:34.553604 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5d645725-90f5-4d00-aadc-068b5afc5720 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:34.566952 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-a930bd8f-d0f0-4340-8ee9-a1e831297ae5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:34.570343 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-5d645725-90f5-4d00-aadc-068b5afc5720 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Getting quotas for project e293f2b3de9143ad9e8a1fe8b67d6641. Resources: {'cores', 'instances', 'ram'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:49:34.574310 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-5d645725-90f5-4d00-aadc-068b5afc5720 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Getting quotas for user 718a82d2f4294f68965ce01aac0fc166 and project e293f2b3de9143ad9e8a1fe8b67d6641. Resources: {'cores', 'instances', 'ram'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:49:34.575442 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-a930bd8f-d0f0-4340-8ee9-a1e831297ae5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:34.577059 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-a930bd8f-d0f0-4340-8ee9-a1e831297ae5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:34.578264 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-a930bd8f-d0f0-4340-8ee9-a1e831297ae5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1724 microversion: 2.20 time: 0.219937 May 23 16:49:34.589395 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 169/349] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:34 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:49:34.589395 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-b9747349-851e-4830-8fe6-0d0906786fd8 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:34.589395 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-b9747349-851e-4830-8fe6-0d0906786fd8 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:34.589761 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-5d645725-90f5-4d00-aadc-068b5afc5720 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Going to run 1 instances... {{(pid=124715) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 16:49:34.589761 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-5d645725-90f5-4d00-aadc-068b5afc5720 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96972e76-879d-4149-a713-a94529892aad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 16:49:34.591301 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b9747349-851e-4830-8fe6-0d0906786fd8 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:34.591765 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b9747349-851e-4830-8fe6-0d0906786fd8 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:34.592574 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b9747349-851e-4830-8fe6-0d0906786fd8 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:34.593017 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b9747349-851e-4830-8fe6-0d0906786fd8 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:34.597464 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=100 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:34.730111 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b9747349-851e-4830-8fe6-0d0906786fd8 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:34.737674 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-b9747349-851e-4830-8fe6-0d0906786fd8 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.157751 May 23 16:49:34.738234 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 170/350] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:34 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:34.765522 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-5d645725-90f5-4d00-aadc-068b5afc5720 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.982427 May 23 16:49:34.766324 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 181/351] 10.222.0.74 () {60 vars in 1146 bytes} [Mon May 23 16:49:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 16:49:34.775942 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-f0b3cbee-a4fe-4a95-a17b-7528f34bc581 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:34.776662 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-f0b3cbee-a4fe-4a95-a17b-7528f34bc581 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:34.829825 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-f0b3cbee-a4fe-4a95-a17b-7528f34bc581 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:34.836817 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-f0b3cbee-a4fe-4a95-a17b-7528f34bc581 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 200 len: 1240 microversion: 2.1 time: 0.064616 May 23 16:49:34.837424 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 171/352] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:34 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:35.597732 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-0d5b0aaf-2882-4195-8601-1c87e5ce4f9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:35.598348 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-0d5b0aaf-2882-4195-8601-1c87e5ce4f9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:35.600239 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:35.606243 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0d5b0aaf-2882-4195-8601-1c87e5ce4f9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:35.606998 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0d5b0aaf-2882-4195-8601-1c87e5ce4f9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:35.607824 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0d5b0aaf-2882-4195-8601-1c87e5ce4f9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:35.608272 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0d5b0aaf-2882-4195-8601-1c87e5ce4f9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:35.735520 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-0d5b0aaf-2882-4195-8601-1c87e5ce4f9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:35.743401 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-0d5b0aaf-2882-4195-8601-1c87e5ce4f9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:35.746994 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-0d5b0aaf-2882-4195-8601-1c87e5ce4f9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:35.746994 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-0d5b0aaf-2882-4195-8601-1c87e5ce4f9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1724 microversion: 2.20 time: 0.152840 May 23 16:49:35.747328 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 182/353] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:35 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:35.755457 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-f3b20d89-4da9-4343-bf71-3b4d79d769ad tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:35.756215 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-f3b20d89-4da9-4343-bf71-3b4d79d769ad tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:35.763124 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f3b20d89-4da9-4343-bf71-3b4d79d769ad tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:35.763601 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f3b20d89-4da9-4343-bf71-3b4d79d769ad tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:35.764389 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f3b20d89-4da9-4343-bf71-3b4d79d769ad tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:35.764855 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f3b20d89-4da9-4343-bf71-3b4d79d769ad tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:35.854617 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-1e729d20-0787-4323-a138-dfc81c0c35da tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:35.855378 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-1e729d20-0787-4323-a138-dfc81c0c35da tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:35.862411 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1e729d20-0787-4323-a138-dfc81c0c35da tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:35.862950 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1e729d20-0787-4323-a138-dfc81c0c35da tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:35.863794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1e729d20-0787-4323-a138-dfc81c0c35da tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:35.864332 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1e729d20-0787-4323-a138-dfc81c0c35da tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:35.897079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-f3b20d89-4da9-4343-bf71-3b4d79d769ad tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:35.905329 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-f3b20d89-4da9-4343-bf71-3b4d79d769ad tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.153995 May 23 16:49:35.905969 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 172/354] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:35 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:35.926567 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-1e729d20-0787-4323-a138-dfc81c0c35da tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:35.934124 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-1e729d20-0787-4323-a138-dfc81c0c35da tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 200 len: 1244 microversion: 2.1 time: 0.083418 May 23 16:49:35.934714 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 183/355] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:35 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:36.766190 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-7e79ec60-7ef6-4140-9005-d140cdea5e33 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:36.766809 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-7e79ec60-7ef6-4140-9005-d140cdea5e33 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:36.769235 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:36.774099 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7e79ec60-7ef6-4140-9005-d140cdea5e33 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:36.774552 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7e79ec60-7ef6-4140-9005-d140cdea5e33 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:36.775434 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7e79ec60-7ef6-4140-9005-d140cdea5e33 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:36.775914 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7e79ec60-7ef6-4140-9005-d140cdea5e33 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:36.906151 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7e79ec60-7ef6-4140-9005-d140cdea5e33 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:36.914470 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7e79ec60-7ef6-4140-9005-d140cdea5e33 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:36.915984 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7e79ec60-7ef6-4140-9005-d140cdea5e33 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:36.917255 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-7e79ec60-7ef6-4140-9005-d140cdea5e33 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1724 microversion: 2.20 time: 0.156114 May 23 16:49:36.918778 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 173/356] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:36 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:36.923674 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-f3ee99e9-1ead-4fe4-8a94-7a894949403e tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:36.924308 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-f3ee99e9-1ead-4fe4-8a94-7a894949403e tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:36.930684 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f3ee99e9-1ead-4fe4-8a94-7a894949403e tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:36.931130 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f3ee99e9-1ead-4fe4-8a94-7a894949403e tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:36.932160 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f3ee99e9-1ead-4fe4-8a94-7a894949403e tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:36.932636 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f3ee99e9-1ead-4fe4-8a94-7a894949403e tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:36.950876 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-288c5246-2e59-48b5-a2e9-79c1f2dff1c4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:36.951495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-288c5246-2e59-48b5-a2e9-79c1f2dff1c4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:36.957467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-288c5246-2e59-48b5-a2e9-79c1f2dff1c4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:36.958177 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-288c5246-2e59-48b5-a2e9-79c1f2dff1c4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:36.958953 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-288c5246-2e59-48b5-a2e9-79c1f2dff1c4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:36.959397 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-288c5246-2e59-48b5-a2e9-79c1f2dff1c4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:37.030656 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-288c5246-2e59-48b5-a2e9-79c1f2dff1c4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:37.038152 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-288c5246-2e59-48b5-a2e9-79c1f2dff1c4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 200 len: 1244 microversion: 2.1 time: 0.091091 May 23 16:49:37.038735 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 174/357] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:36 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:49:37.091093 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f3ee99e9-1ead-4fe4-8a94-7a894949403e tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:37.098535 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-f3ee99e9-1ead-4fe4-8a94-7a894949403e tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.178621 May 23 16:49:37.099101 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 184/358] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:36 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:37.100849 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ac5777ea-e07b-4cef-bfda-d2f0c44602a6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:37.101356 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ac5777ea-e07b-4cef-bfda-d2f0c44602a6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:37.107907 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ac5777ea-e07b-4cef-bfda-d2f0c44602a6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:37.108385 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ac5777ea-e07b-4cef-bfda-d2f0c44602a6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:37.109160 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ac5777ea-e07b-4cef-bfda-d2f0c44602a6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:37.109606 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ac5777ea-e07b-4cef-bfda-d2f0c44602a6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:37.132864 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ac5777ea-e07b-4cef-bfda-d2f0c44602a6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4/ips" status: 200 len: 145 microversion: 2.1 time: 0.035775 May 23 16:49:37.133421 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 175/359] 10.222.0.74 () {58 vars in 1247 bytes} [Mon May 23 16:49:37 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:49:37.935956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-0e04fb83-6fb0-48a0-9be3-bc708b7688c2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:37.936516 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-0e04fb83-6fb0-48a0-9be3-bc708b7688c2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:37.943610 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0e04fb83-6fb0-48a0-9be3-bc708b7688c2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:37.948426 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0e04fb83-6fb0-48a0-9be3-bc708b7688c2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:37.948426 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0e04fb83-6fb0-48a0-9be3-bc708b7688c2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:37.948426 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0e04fb83-6fb0-48a0-9be3-bc708b7688c2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:38.055045 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-e4f47929-4b6c-4fbc-b107-f4584ec9ab54 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:38.055800 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-e4f47929-4b6c-4fbc-b107-f4584ec9ab54 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:38.062825 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e4f47929-4b6c-4fbc-b107-f4584ec9ab54 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:38.063389 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e4f47929-4b6c-4fbc-b107-f4584ec9ab54 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:38.064341 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e4f47929-4b6c-4fbc-b107-f4584ec9ab54 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:38.064967 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e4f47929-4b6c-4fbc-b107-f4584ec9ab54 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:38.080465 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-0e04fb83-6fb0-48a0-9be3-bc708b7688c2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:38.087612 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-0e04fb83-6fb0-48a0-9be3-bc708b7688c2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:38.089161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-0e04fb83-6fb0-48a0-9be3-bc708b7688c2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:38.090814 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-0e04fb83-6fb0-48a0-9be3-bc708b7688c2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1724 microversion: 2.20 time: 0.158524 May 23 16:49:38.091213 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 185/360] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:37 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:38.115300 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-87169509-4914-41b1-96a2-d3efaf0e49c9 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:38.115920 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-87169509-4914-41b1-96a2-d3efaf0e49c9 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:38.122745 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-87169509-4914-41b1-96a2-d3efaf0e49c9 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:38.133241 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-87169509-4914-41b1-96a2-d3efaf0e49c9 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:38.133241 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-87169509-4914-41b1-96a2-d3efaf0e49c9 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:38.133241 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-87169509-4914-41b1-96a2-d3efaf0e49c9 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:38.134642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e4f47929-4b6c-4fbc-b107-f4584ec9ab54 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:38.142749 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-e4f47929-4b6c-4fbc-b107-f4584ec9ab54 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 200 len: 1236 microversion: 2.1 time: 0.091611 May 23 16:49:38.143321 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 176/361] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:38 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 1236 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:49:38.258834 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-87169509-4914-41b1-96a2-d3efaf0e49c9 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:38.266757 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-87169509-4914-41b1-96a2-d3efaf0e49c9 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.155463 May 23 16:49:38.267315 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 186/362] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:38 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:49:39.109572 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-d713701f-dac1-46af-b8d9-73ca096d69bc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:39.110094 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-d713701f-dac1-46af-b8d9-73ca096d69bc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:39.116466 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d713701f-dac1-46af-b8d9-73ca096d69bc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:39.116911 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d713701f-dac1-46af-b8d9-73ca096d69bc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:39.117657 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d713701f-dac1-46af-b8d9-73ca096d69bc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:39.118117 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d713701f-dac1-46af-b8d9-73ca096d69bc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:39.159923 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-6a71ebf0-0e09-46f6-b621-e9716d18364a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:39.160573 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-6a71ebf0-0e09-46f6-b621-e9716d18364a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:39.166956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a71ebf0-0e09-46f6-b621-e9716d18364a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:39.167403 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a71ebf0-0e09-46f6-b621-e9716d18364a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:39.168188 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a71ebf0-0e09-46f6-b621-e9716d18364a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:39.168706 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a71ebf0-0e09-46f6-b621-e9716d18364a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:39.243502 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-6a71ebf0-0e09-46f6-b621-e9716d18364a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:39.255994 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-6a71ebf0-0e09-46f6-b621-e9716d18364a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 200 len: 1292 microversion: 2.1 time: 0.099536 May 23 16:49:39.258583 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 187/363] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:39 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 1292 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:49:39.283935 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-21c2fd43-1392-4506-9906-58a07a1e8176 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:39.286090 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-21c2fd43-1392-4506-9906-58a07a1e8176 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:39.294631 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-21c2fd43-1392-4506-9906-58a07a1e8176 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:39.294779 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-d713701f-dac1-46af-b8d9-73ca096d69bc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:39.295483 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-21c2fd43-1392-4506-9906-58a07a1e8176 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:39.296999 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-21c2fd43-1392-4506-9906-58a07a1e8176 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:39.297647 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-21c2fd43-1392-4506-9906-58a07a1e8176 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:39.307185 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-d713701f-dac1-46af-b8d9-73ca096d69bc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:39.307185 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-d713701f-dac1-46af-b8d9-73ca096d69bc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:39.307185 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-d713701f-dac1-46af-b8d9-73ca096d69bc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1724 microversion: 2.20 time: 0.202251 May 23 16:49:39.318742 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 177/364] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:39 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:39.450702 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-21c2fd43-1392-4506-9906-58a07a1e8176 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:39.458912 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-21c2fd43-1392-4506-9906-58a07a1e8176 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.178947 May 23 16:49:39.459489 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 188/365] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:39 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:39.806936 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-23f82710-7d99-427a-b444-37b88d3e951f req-d64e90d9-76d4-4d0e-9b51-6c52089baea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e337be75-f64c-4c86-97f1-e31cf55a6089", "name": "network-vif-plugged", "status": "completed", "tag": "5141686c-093d-45da-8646-a43dcece1e63"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:49:39.818247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-23f82710-7d99-427a-b444-37b88d3e951f req-d64e90d9-76d4-4d0e-9b51-6c52089baea1 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:39.818701 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-23f82710-7d99-427a-b444-37b88d3e951f req-d64e90d9-76d4-4d0e-9b51-6c52089baea1 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:39.830674 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-23f82710-7d99-427a-b444-37b88d3e951f req-d64e90d9-76d4-4d0e-9b51-6c52089baea1 service nova] Creating event network-vif-plugged:5141686c-093d-45da-8646-a43dcece1e63 for instance e337be75-f64c-4c86-97f1-e31cf55a6089 on hv-cinder-83925 May 23 16:49:39.836181 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-23f82710-7d99-427a-b444-37b88d3e951f req-d64e90d9-76d4-4d0e-9b51-6c52089baea1 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033075 May 23 16:49:39.837151 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 178/366] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:49:40.275183 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-ae327cdb-e860-4918-832e-7695de33d6c8 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:40.275981 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-ae327cdb-e860-4918-832e-7695de33d6c8 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:40.282806 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ae327cdb-e860-4918-832e-7695de33d6c8 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:40.283262 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ae327cdb-e860-4918-832e-7695de33d6c8 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:40.284037 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ae327cdb-e860-4918-832e-7695de33d6c8 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:40.284515 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ae327cdb-e860-4918-832e-7695de33d6c8 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:40.328541 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ab282c32-825a-4a5a-9670-c9dcdf9dafe9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:40.329961 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ab282c32-825a-4a5a-9670-c9dcdf9dafe9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:40.338120 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ab282c32-825a-4a5a-9670-c9dcdf9dafe9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:40.339316 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ab282c32-825a-4a5a-9670-c9dcdf9dafe9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:40.340155 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ab282c32-825a-4a5a-9670-c9dcdf9dafe9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:40.340900 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ab282c32-825a-4a5a-9670-c9dcdf9dafe9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:40.365784 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-ae327cdb-e860-4918-832e-7695de33d6c8 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:40.374727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-ae327cdb-e860-4918-832e-7695de33d6c8 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 200 len: 1298 microversion: 2.1 time: 0.103520 May 23 16:49:40.375313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 189/367] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:40 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:40.476588 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-34e80640-b455-427b-808f-0e7de3ad44fb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77cfd71f-5637-4839-b03e-e0581af6aee0"}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:49:40.477709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-34e80640-b455-427b-808f-0e7de3ad44fb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:40.483839 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-34e80640-b455-427b-808f-0e7de3ad44fb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:40.484287 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-34e80640-b455-427b-808f-0e7de3ad44fb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:40.485090 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-34e80640-b455-427b-808f-0e7de3ad44fb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:40.485522 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-34e80640-b455-427b-808f-0e7de3ad44fb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:40.502059 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ab282c32-825a-4a5a-9670-c9dcdf9dafe9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:40.510046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ab282c32-825a-4a5a-9670-c9dcdf9dafe9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:40.511535 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ab282c32-825a-4a5a-9670-c9dcdf9dafe9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:40.513311 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ab282c32-825a-4a5a-9670-c9dcdf9dafe9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1724 microversion: 2.20 time: 0.191751 May 23 16:49:40.514101 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 179/368] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:40 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:49:40.518604 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-615a8f15-c9b1-47e6-bd37-ec07932be661 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:40.519206 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-615a8f15-c9b1-47e6-bd37-ec07932be661 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:40.529394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-615a8f15-c9b1-47e6-bd37-ec07932be661 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:40.530070 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-615a8f15-c9b1-47e6-bd37-ec07932be661 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:40.531944 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-615a8f15-c9b1-47e6-bd37-ec07932be661 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:40.531944 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-615a8f15-c9b1-47e6-bd37-ec07932be661 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:40.740723 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-615a8f15-c9b1-47e6-bd37-ec07932be661 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:40.750522 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-615a8f15-c9b1-47e6-bd37-ec07932be661 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.235195 May 23 16:49:40.751251 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 180/369] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:40 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:41.694766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-955beca2-ea83-4879-9295-0576937db3df tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:41.694766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-955beca2-ea83-4879-9295-0576937db3df tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:41.694766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-955beca2-ea83-4879-9295-0576937db3df tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:41.694766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-955beca2-ea83-4879-9295-0576937db3df tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:41.701205 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-955beca2-ea83-4879-9295-0576937db3df tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:41.701205 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-955beca2-ea83-4879-9295-0576937db3df tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:41.701205 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-955beca2-ea83-4879-9295-0576937db3df tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:41.702327 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-955beca2-ea83-4879-9295-0576937db3df tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 200 len: 1366 microversion: 2.1 time: 0.215843 May 23 16:49:41.702327 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 181/370] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:41 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:41.702327 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-8e76bf50-1881-4e09-832b-2dbf8a83a7e2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:41.702327 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-8e76bf50-1881-4e09-832b-2dbf8a83a7e2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:41.702327 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8e76bf50-1881-4e09-832b-2dbf8a83a7e2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:41.702753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8e76bf50-1881-4e09-832b-2dbf8a83a7e2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:41.702753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8e76bf50-1881-4e09-832b-2dbf8a83a7e2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:41.702753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8e76bf50-1881-4e09-832b-2dbf8a83a7e2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:41.822762 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8e76bf50-1881-4e09-832b-2dbf8a83a7e2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:41.834655 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8e76bf50-1881-4e09-832b-2dbf8a83a7e2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:41.836839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8e76bf50-1881-4e09-832b-2dbf8a83a7e2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:41.842895 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-8e76bf50-1881-4e09-832b-2dbf8a83a7e2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1724 microversion: 2.20 time: 0.223652 May 23 16:49:41.842895 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 182/371] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:41 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:41.852079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-aed94758-b038-4cbc-b951-6c930e737506 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:41.852783 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-aed94758-b038-4cbc-b951-6c930e737506 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:41.860866 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-aed94758-b038-4cbc-b951-6c930e737506 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:41.866178 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-aed94758-b038-4cbc-b951-6c930e737506 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:41.866178 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-aed94758-b038-4cbc-b951-6c930e737506 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:41.866178 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-aed94758-b038-4cbc-b951-6c930e737506 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:42.050861 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-aed94758-b038-4cbc-b951-6c930e737506 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:42.059367 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-aed94758-b038-4cbc-b951-6c930e737506 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1358 microversion: 2.1 time: 0.218727 May 23 16:49:42.060637 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 183/372] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:41 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:42.065452 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-71378a38-169a-4c07-a02e-13d40c099865 req-13ea5447-35cd-4fc9-8184-27f1e1e63713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d413ebb5-7e19-40ba-810b-505e89c582ef", "tag": "f53be2ff-ed66-407e-961f-9ac93b76ebe4"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:49:42.073475 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-71378a38-169a-4c07-a02e-13d40c099865 req-13ea5447-35cd-4fc9-8184-27f1e1e63713 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:42.073930 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-71378a38-169a-4c07-a02e-13d40c099865 req-13ea5447-35cd-4fc9-8184-27f1e1e63713 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:42.086803 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-71378a38-169a-4c07-a02e-13d40c099865 req-13ea5447-35cd-4fc9-8184-27f1e1e63713 service nova] Creating event network-changed:f53be2ff-ed66-407e-961f-9ac93b76ebe4 for instance d413ebb5-7e19-40ba-810b-505e89c582ef on hv-cinder-83925 May 23 16:49:42.092304 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-71378a38-169a-4c07-a02e-13d40c099865 req-13ea5447-35cd-4fc9-8184-27f1e1e63713 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030358 May 23 16:49:42.092916 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 184/373] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:49:42.426094 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-34e80640-b455-427b-808f-0e7de3ad44fb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "POST /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.953249 May 23 16:49:42.427031 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 190/374] 10.222.0.74 () {60 vars in 1322 bytes} [Mon May 23 16:49:40 2022] POST /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4/os-volume_attachments => generated 194 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:49:42.635201 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-7261bc4f-b3b1-411c-ad2b-04bc246fd5a5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:42.635201 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-7261bc4f-b3b1-411c-ad2b-04bc246fd5a5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:42.640973 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7261bc4f-b3b1-411c-ad2b-04bc246fd5a5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:42.641429 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7261bc4f-b3b1-411c-ad2b-04bc246fd5a5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:42.642309 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7261bc4f-b3b1-411c-ad2b-04bc246fd5a5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:42.643016 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7261bc4f-b3b1-411c-ad2b-04bc246fd5a5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:42.859901 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c9f00d46-fe39-46d8-a778-2bc87d510518 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:42.861063 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-c9f00d46-fe39-46d8-a778-2bc87d510518 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:42.875732 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7261bc4f-b3b1-411c-ad2b-04bc246fd5a5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:42.882895 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c9f00d46-fe39-46d8-a778-2bc87d510518 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:42.885416 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c9f00d46-fe39-46d8-a778-2bc87d510518 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:42.887105 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c9f00d46-fe39-46d8-a778-2bc87d510518 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:42.888619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c9f00d46-fe39-46d8-a778-2bc87d510518 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:42.899866 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-7261bc4f-b3b1-411c-ad2b-04bc246fd5a5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 200 len: 1366 microversion: 2.1 time: 0.272993 May 23 16:49:42.902768 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 185/375] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:42 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:42.916184 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:43.078499 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-a050673c-0c6c-4d97-aadc-9500a3d85729 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:43.079129 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-a050673c-0c6c-4d97-aadc-9500a3d85729 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:43.085509 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a050673c-0c6c-4d97-aadc-9500a3d85729 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:43.085840 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a050673c-0c6c-4d97-aadc-9500a3d85729 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:43.086610 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a050673c-0c6c-4d97-aadc-9500a3d85729 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:43.087056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a050673c-0c6c-4d97-aadc-9500a3d85729 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:43.088354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-c9f00d46-fe39-46d8-a778-2bc87d510518 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:43.097492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-c9f00d46-fe39-46d8-a778-2bc87d510518 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:43.099005 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-c9f00d46-fe39-46d8-a778-2bc87d510518 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:43.100504 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-c9f00d46-fe39-46d8-a778-2bc87d510518 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1724 microversion: 2.20 time: 0.246565 May 23 16:49:43.101233 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 191/376] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:42 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:43.219943 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-a050673c-0c6c-4d97-aadc-9500a3d85729 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:43.227495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-a050673c-0c6c-4d97-aadc-9500a3d85729 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1548 microversion: 2.1 time: 0.153937 May 23 16:49:43.228049 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 186/377] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:43 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:49:43.244186 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-9096bbb9-edfd-41a9-a5e1-85d0fa2df7d2 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:43.244832 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-9096bbb9-edfd-41a9-a5e1-85d0fa2df7d2 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:43.252318 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9096bbb9-edfd-41a9-a5e1-85d0fa2df7d2 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:43.256710 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9096bbb9-edfd-41a9-a5e1-85d0fa2df7d2 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:43.256710 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9096bbb9-edfd-41a9-a5e1-85d0fa2df7d2 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:43.256710 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9096bbb9-edfd-41a9-a5e1-85d0fa2df7d2 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:43.384022 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-9096bbb9-edfd-41a9-a5e1-85d0fa2df7d2 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:43.392606 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-9096bbb9-edfd-41a9-a5e1-85d0fa2df7d2 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1548 microversion: 2.1 time: 0.152235 May 23 16:49:43.393365 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 192/378] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:43 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:43.408917 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-a6e86e4b-b515-4fc3-953c-55795e97d185 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:43.412436 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-a6e86e4b-b515-4fc3-953c-55795e97d185 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:43.413194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-a6e86e4b-b515-4fc3-953c-55795e97d185 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Searching by: {'deleted': False, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01'} {{(pid=124714) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 23 16:49:43.419660 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a6e86e4b-b515-4fc3-953c-55795e97d185 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:43.420138 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a6e86e4b-b515-4fc3-953c-55795e97d185 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:43.420962 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a6e86e4b-b515-4fc3-953c-55795e97d185 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:43.421392 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a6e86e4b-b515-4fc3-953c-55795e97d185 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:43.511248 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.multi_cell_list [None req-a6e86e4b-b515-4fc3-953c-55795e97d185 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124714) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 23 16:49:43.610194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-a6e86e4b-b515-4fc3-953c-55795e97d185 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.205785 May 23 16:49:43.610693 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 187/379] 10.222.0.74 () {58 vars in 1124 bytes} [Mon May 23 16:49:43 2022] GET /compute/v2.1/servers => generated 343 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:49:43.620698 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a4d27a01-7c65-43a4-98db-ff82a582d8b6 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:43.621310 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a4d27a01-7c65-43a4-98db-ff82a582d8b6 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:43.627796 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a4d27a01-7c65-43a4-98db-ff82a582d8b6 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:43.628241 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a4d27a01-7c65-43a4-98db-ff82a582d8b6 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:43.629085 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a4d27a01-7c65-43a4-98db-ff82a582d8b6 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:43.629470 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a4d27a01-7c65-43a4-98db-ff82a582d8b6 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:43.761733 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a4d27a01-7c65-43a4-98db-ff82a582d8b6 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:43.769787 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a4d27a01-7c65-43a4-98db-ff82a582d8b6 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1548 microversion: 2.1 time: 0.152780 May 23 16:49:43.770364 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 193/380] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:43 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:43.918379 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-cb34b1ee-ad8a-43e2-aeae-445121e9ec1b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:43.919556 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-cb34b1ee-ad8a-43e2-aeae-445121e9ec1b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:43.926103 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cb34b1ee-ad8a-43e2-aeae-445121e9ec1b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:43.933256 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cb34b1ee-ad8a-43e2-aeae-445121e9ec1b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:43.933256 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cb34b1ee-ad8a-43e2-aeae-445121e9ec1b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:43.933256 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cb34b1ee-ad8a-43e2-aeae-445121e9ec1b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:44.065435 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-cb34b1ee-ad8a-43e2-aeae-445121e9ec1b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:44.073048 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-cb34b1ee-ad8a-43e2-aeae-445121e9ec1b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 200 len: 1366 microversion: 2.1 time: 0.158746 May 23 16:49:44.076548 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 188/381] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:43 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:44.119371 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-3c631010-376e-4380-8b39-5a5c8609ac50 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:44.119992 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-3c631010-376e-4380-8b39-5a5c8609ac50 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:44.127373 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3c631010-376e-4380-8b39-5a5c8609ac50 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:44.127968 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3c631010-376e-4380-8b39-5a5c8609ac50 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:44.128783 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3c631010-376e-4380-8b39-5a5c8609ac50 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:44.129229 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3c631010-376e-4380-8b39-5a5c8609ac50 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:44.266691 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-3c631010-376e-4380-8b39-5a5c8609ac50 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:44.274906 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-3c631010-376e-4380-8b39-5a5c8609ac50 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:44.276453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-3c631010-376e-4380-8b39-5a5c8609ac50 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:44.277645 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-3c631010-376e-4380-8b39-5a5c8609ac50 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1724 microversion: 2.20 time: 0.162282 May 23 16:49:44.278207 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 194/382] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:44 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:45.092076 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-63d79f94-6da1-4f81-85f6-f8cde32e7caa tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:45.096487 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-63d79f94-6da1-4f81-85f6-f8cde32e7caa tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:45.096487 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=6 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:45.100739 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-63d79f94-6da1-4f81-85f6-f8cde32e7caa tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:45.101198 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-63d79f94-6da1-4f81-85f6-f8cde32e7caa tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:45.102018 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-63d79f94-6da1-4f81-85f6-f8cde32e7caa tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:45.102542 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-63d79f94-6da1-4f81-85f6-f8cde32e7caa tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:45.107241 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=100 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:45.248063 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-63d79f94-6da1-4f81-85f6-f8cde32e7caa tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:45.255498 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-63d79f94-6da1-4f81-85f6-f8cde32e7caa tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 200 len: 1366 microversion: 2.1 time: 0.167791 May 23 16:49:45.256068 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 189/383] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:45 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:45.294912 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-18aea681-2dd8-4bdd-aab0-54df55ffca50 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:45.295516 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-18aea681-2dd8-4bdd-aab0-54df55ffca50 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:45.297402 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=2 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:45.298056 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=6 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:45.303173 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-18aea681-2dd8-4bdd-aab0-54df55ffca50 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:45.303616 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-18aea681-2dd8-4bdd-aab0-54df55ffca50 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:45.304396 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-18aea681-2dd8-4bdd-aab0-54df55ffca50 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:45.304830 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-18aea681-2dd8-4bdd-aab0-54df55ffca50 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:45.434148 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-18aea681-2dd8-4bdd-aab0-54df55ffca50 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:45.442703 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-18aea681-2dd8-4bdd-aab0-54df55ffca50 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:45.456941 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-18aea681-2dd8-4bdd-aab0-54df55ffca50 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:45.456941 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-18aea681-2dd8-4bdd-aab0-54df55ffca50 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1724 microversion: 2.20 time: 0.154322 May 23 16:49:45.456941 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 195/384] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:45 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:45.677943 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ecd6c385-db8b-4324-9ba0-a95b6a816bec tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f28cb943-4e4e-4b94-8604-20ac5df89122"}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:49:45.679002 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ecd6c385-db8b-4324-9ba0-a95b6a816bec tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:45.684975 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ecd6c385-db8b-4324-9ba0-a95b6a816bec tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:45.685426 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ecd6c385-db8b-4324-9ba0-a95b6a816bec tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:45.686711 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ecd6c385-db8b-4324-9ba0-a95b6a816bec tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:45.687140 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ecd6c385-db8b-4324-9ba0-a95b6a816bec tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:46.274045 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-9c7cee7f-4b4b-42ef-aad6-608e28c4462c tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:46.274703 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-9c7cee7f-4b4b-42ef-aad6-608e28c4462c tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:46.283194 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9c7cee7f-4b4b-42ef-aad6-608e28c4462c tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:46.283652 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9c7cee7f-4b4b-42ef-aad6-608e28c4462c tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:46.284477 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9c7cee7f-4b4b-42ef-aad6-608e28c4462c tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:46.284915 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9c7cee7f-4b4b-42ef-aad6-608e28c4462c tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:46.424760 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-9c7cee7f-4b4b-42ef-aad6-608e28c4462c tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:46.432164 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-9c7cee7f-4b4b-42ef-aad6-608e28c4462c tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 200 len: 1366 microversion: 2.1 time: 0.162693 May 23 16:49:46.432767 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 196/385] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:46 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:49:46.464314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-22f01fd7-35fc-49e3-97b7-0089cfd1b348 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:46.464926 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-22f01fd7-35fc-49e3-97b7-0089cfd1b348 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:46.470811 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-22f01fd7-35fc-49e3-97b7-0089cfd1b348 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:46.471264 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-22f01fd7-35fc-49e3-97b7-0089cfd1b348 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:46.472030 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-22f01fd7-35fc-49e3-97b7-0089cfd1b348 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:46.472566 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-22f01fd7-35fc-49e3-97b7-0089cfd1b348 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:46.494137 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ecd6c385-db8b-4324-9ba0-a95b6a816bec tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "POST /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.819837 May 23 16:49:46.494996 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 190/386] 10.222.0.74 () {60 vars in 1322 bytes} [Mon May 23 16:49:45 2022] POST /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089/os-volume_attachments => generated 194 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:49:46.613584 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-22f01fd7-35fc-49e3-97b7-0089cfd1b348 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:46.622183 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-22f01fd7-35fc-49e3-97b7-0089cfd1b348 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:46.624787 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-22f01fd7-35fc-49e3-97b7-0089cfd1b348 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:46.626050 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-22f01fd7-35fc-49e3-97b7-0089cfd1b348 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1724 microversion: 2.20 time: 0.165526 May 23 16:49:46.626687 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 197/387] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:46 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:49:47.450504 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-3e9baa96-ee2e-4e19-82cb-79c6c9b33b25 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:47.451456 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-3e9baa96-ee2e-4e19-82cb-79c6c9b33b25 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:47.458033 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3e9baa96-ee2e-4e19-82cb-79c6c9b33b25 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:47.458491 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3e9baa96-ee2e-4e19-82cb-79c6c9b33b25 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:47.459262 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3e9baa96-ee2e-4e19-82cb-79c6c9b33b25 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:47.459707 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3e9baa96-ee2e-4e19-82cb-79c6c9b33b25 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:47.598904 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-3e9baa96-ee2e-4e19-82cb-79c6c9b33b25 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:47.614746 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-3e9baa96-ee2e-4e19-82cb-79c6c9b33b25 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 200 len: 1366 microversion: 2.1 time: 0.161716 May 23 16:49:47.614746 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 191/388] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:47 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:47.644748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-fbe337c3-1272-4b87-ab74-5fc321028e70 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:47.645366 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-fbe337c3-1272-4b87-ab74-5fc321028e70 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:47.651690 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fbe337c3-1272-4b87-ab74-5fc321028e70 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:47.652141 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fbe337c3-1272-4b87-ab74-5fc321028e70 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:47.652937 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fbe337c3-1272-4b87-ab74-5fc321028e70 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:47.653386 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fbe337c3-1272-4b87-ab74-5fc321028e70 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:47.796764 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-fbe337c3-1272-4b87-ab74-5fc321028e70 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:47.801845 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-fbe337c3-1272-4b87-ab74-5fc321028e70 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:47.803349 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-fbe337c3-1272-4b87-ab74-5fc321028e70 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:47.804548 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-fbe337c3-1272-4b87-ab74-5fc321028e70 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1745 microversion: 2.20 time: 0.163657 May 23 16:49:47.805117 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 198/389] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:47 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:48.626020 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-a3e6a9a7-c9d4-4ccd-93ef-29d7eefee3a9 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:48.626741 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-a3e6a9a7-c9d4-4ccd-93ef-29d7eefee3a9 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:48.633373 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a3e6a9a7-c9d4-4ccd-93ef-29d7eefee3a9 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:48.633829 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a3e6a9a7-c9d4-4ccd-93ef-29d7eefee3a9 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:48.634637 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a3e6a9a7-c9d4-4ccd-93ef-29d7eefee3a9 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:48.635082 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a3e6a9a7-c9d4-4ccd-93ef-29d7eefee3a9 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:48.766832 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-a3e6a9a7-c9d4-4ccd-93ef-29d7eefee3a9 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:48.774356 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-a3e6a9a7-c9d4-4ccd-93ef-29d7eefee3a9 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 200 len: 1366 microversion: 2.1 time: 0.153121 May 23 16:49:48.774932 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 192/390] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:48 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:48.822964 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-8c49ca78-75c7-4c71-93db-8174aaef3ff9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:48.823838 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-8c49ca78-75c7-4c71-93db-8174aaef3ff9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:48.831372 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8c49ca78-75c7-4c71-93db-8174aaef3ff9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:48.831822 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8c49ca78-75c7-4c71-93db-8174aaef3ff9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:48.832625 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8c49ca78-75c7-4c71-93db-8174aaef3ff9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:48.833556 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8c49ca78-75c7-4c71-93db-8174aaef3ff9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:48.958061 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-8c49ca78-75c7-4c71-93db-8174aaef3ff9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:48.965938 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-8c49ca78-75c7-4c71-93db-8174aaef3ff9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:48.967384 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-8c49ca78-75c7-4c71-93db-8174aaef3ff9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:48.968567 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-8c49ca78-75c7-4c71-93db-8174aaef3ff9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1745 microversion: 2.20 time: 0.149510 May 23 16:49:48.969131 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 199/391] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:48 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:49.694855 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-eb859a4c-7e9b-4395-b40e-781d13200c87 req-3a6edf1f-12aa-45b3-8324-5dceca292546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d413ebb5-7e19-40ba-810b-505e89c582ef", "name": "network-vif-plugged", "status": "completed", "tag": "f53be2ff-ed66-407e-961f-9ac93b76ebe4"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:49:49.704674 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-eb859a4c-7e9b-4395-b40e-781d13200c87 req-3a6edf1f-12aa-45b3-8324-5dceca292546 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:49.705164 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-eb859a4c-7e9b-4395-b40e-781d13200c87 req-3a6edf1f-12aa-45b3-8324-5dceca292546 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:49.719142 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-eb859a4c-7e9b-4395-b40e-781d13200c87 req-3a6edf1f-12aa-45b3-8324-5dceca292546 service nova] Creating event network-vif-plugged:f53be2ff-ed66-407e-961f-9ac93b76ebe4 for instance d413ebb5-7e19-40ba-810b-505e89c582ef on hv-cinder-83925 May 23 16:49:49.725530 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-eb859a4c-7e9b-4395-b40e-781d13200c87 req-3a6edf1f-12aa-45b3-8324-5dceca292546 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034394 May 23 16:49:49.726133 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 193/392] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:49:49.791429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-3065ab72-6b71-4a49-bff5-051ac96c5392 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:49.792063 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-3065ab72-6b71-4a49-bff5-051ac96c5392 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:49.798084 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3065ab72-6b71-4a49-bff5-051ac96c5392 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:49.798535 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3065ab72-6b71-4a49-bff5-051ac96c5392 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:49.799304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3065ab72-6b71-4a49-bff5-051ac96c5392 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:49.799748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3065ab72-6b71-4a49-bff5-051ac96c5392 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:49.941336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-3065ab72-6b71-4a49-bff5-051ac96c5392 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:49.948870 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-3065ab72-6b71-4a49-bff5-051ac96c5392 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 200 len: 1366 microversion: 2.1 time: 0.161222 May 23 16:49:49.950770 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 200/393] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:49 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:49.987094 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-378cefef-9f6f-49ea-8b46-730d64daea7d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:49.988390 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-378cefef-9f6f-49ea-8b46-730d64daea7d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:49.994506 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-378cefef-9f6f-49ea-8b46-730d64daea7d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:49.994947 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-378cefef-9f6f-49ea-8b46-730d64daea7d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:49.995699 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-378cefef-9f6f-49ea-8b46-730d64daea7d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:49.996131 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-378cefef-9f6f-49ea-8b46-730d64daea7d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:50.401609 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-378cefef-9f6f-49ea-8b46-730d64daea7d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:50.409582 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-378cefef-9f6f-49ea-8b46-730d64daea7d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:50.411101 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-378cefef-9f6f-49ea-8b46-730d64daea7d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:50.412258 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-378cefef-9f6f-49ea-8b46-730d64daea7d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1745 microversion: 2.20 time: 0.429583 May 23 16:49:50.416798 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 194/394] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:49 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1745 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:50.966605 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-052753c4-b8d8-49d5-a471-69ec0728809a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:50.967721 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-052753c4-b8d8-49d5-a471-69ec0728809a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:50.974406 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-052753c4-b8d8-49d5-a471-69ec0728809a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:50.974855 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-052753c4-b8d8-49d5-a471-69ec0728809a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:50.975610 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-052753c4-b8d8-49d5-a471-69ec0728809a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:50.976042 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-052753c4-b8d8-49d5-a471-69ec0728809a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:51.105186 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-052753c4-b8d8-49d5-a471-69ec0728809a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:51.113373 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-052753c4-b8d8-49d5-a471-69ec0728809a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 200 len: 1366 microversion: 2.1 time: 0.150573 May 23 16:49:51.113936 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 201/395] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:50 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:51.431052 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-10981453-9381-4a80-8825-9a1d18fc693c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:51.431660 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-10981453-9381-4a80-8825-9a1d18fc693c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:51.438229 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-10981453-9381-4a80-8825-9a1d18fc693c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:51.438673 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-10981453-9381-4a80-8825-9a1d18fc693c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:51.439426 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-10981453-9381-4a80-8825-9a1d18fc693c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:51.439893 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-10981453-9381-4a80-8825-9a1d18fc693c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:51.579415 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-10981453-9381-4a80-8825-9a1d18fc693c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:51.588946 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-10981453-9381-4a80-8825-9a1d18fc693c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:51.590524 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-10981453-9381-4a80-8825-9a1d18fc693c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:51.592025 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-10981453-9381-4a80-8825-9a1d18fc693c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1745 microversion: 2.20 time: 0.164655 May 23 16:49:51.604505 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 195/396] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:51 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:52.130569 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a9ec3ef3-872d-4bb2-a580-a37e24a06420 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:52.131187 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a9ec3ef3-872d-4bb2-a580-a37e24a06420 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:52.138423 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a9ec3ef3-872d-4bb2-a580-a37e24a06420 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:52.138971 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a9ec3ef3-872d-4bb2-a580-a37e24a06420 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:52.140499 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a9ec3ef3-872d-4bb2-a580-a37e24a06420 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:52.141139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a9ec3ef3-872d-4bb2-a580-a37e24a06420 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:52.303099 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a9ec3ef3-872d-4bb2-a580-a37e24a06420 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:52.314469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a9ec3ef3-872d-4bb2-a580-a37e24a06420 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 200 len: 1366 microversion: 2.1 time: 0.187603 May 23 16:49:52.315090 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 202/397] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:52 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:52.614343 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-b0f43a5b-4c5e-4aa7-9528-07a16bc32819 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:52.615184 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-b0f43a5b-4c5e-4aa7-9528-07a16bc32819 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:52.623594 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b0f43a5b-4c5e-4aa7-9528-07a16bc32819 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:52.624170 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b0f43a5b-4c5e-4aa7-9528-07a16bc32819 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:52.625270 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b0f43a5b-4c5e-4aa7-9528-07a16bc32819 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:52.625818 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b0f43a5b-4c5e-4aa7-9528-07a16bc32819 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:52.775001 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b0f43a5b-4c5e-4aa7-9528-07a16bc32819 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:52.788678 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b0f43a5b-4c5e-4aa7-9528-07a16bc32819 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:52.790340 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b0f43a5b-4c5e-4aa7-9528-07a16bc32819 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:52.791508 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-b0f43a5b-4c5e-4aa7-9528-07a16bc32819 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1745 microversion: 2.20 time: 0.182193 May 23 16:49:52.792067 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 196/398] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:52 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1745 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:53.333612 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-622b638f-406e-4df2-a2b1-e3b55c1000c4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:53.334367 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-622b638f-406e-4df2-a2b1-e3b55c1000c4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:53.341931 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-622b638f-406e-4df2-a2b1-e3b55c1000c4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:53.342395 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-622b638f-406e-4df2-a2b1-e3b55c1000c4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:53.343413 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-622b638f-406e-4df2-a2b1-e3b55c1000c4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:53.343863 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-622b638f-406e-4df2-a2b1-e3b55c1000c4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:53.486412 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-622b638f-406e-4df2-a2b1-e3b55c1000c4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:53.497488 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-622b638f-406e-4df2-a2b1-e3b55c1000c4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 200 len: 1366 microversion: 2.1 time: 0.165316 May 23 16:49:53.498314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 203/399] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:53 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:53.619617 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-6eac0cd3-4ad9-4e8a-8826-b9a6b6eea480 req-b5712183-6e71-4ea9-a494-dbb5220f7de3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb302c29-c30d-4ffa-af9d-1f226fd56357", "name": "network-vif-plugged", "status": "completed", "tag": "bd409a76-162e-44c7-9e54-76b5e47accda"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:49:53.624151 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=2 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:53.629952 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-6eac0cd3-4ad9-4e8a-8826-b9a6b6eea480 req-b5712183-6e71-4ea9-a494-dbb5220f7de3 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:53.630406 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-6eac0cd3-4ad9-4e8a-8826-b9a6b6eea480 req-b5712183-6e71-4ea9-a494-dbb5220f7de3 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:53.641333 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-6eac0cd3-4ad9-4e8a-8826-b9a6b6eea480 req-b5712183-6e71-4ea9-a494-dbb5220f7de3 service nova] Creating event network-vif-plugged:bd409a76-162e-44c7-9e54-76b5e47accda for instance bb302c29-c30d-4ffa-af9d-1f226fd56357 on hv-cinder-83925 May 23 16:49:53.646801 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-6eac0cd3-4ad9-4e8a-8826-b9a6b6eea480 req-b5712183-6e71-4ea9-a494-dbb5220f7de3 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031297 May 23 16:49:53.647392 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 197/400] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:49:53.812010 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-d19d3186-80fd-4d96-8466-ef453c8ba9c3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:53.812773 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-d19d3186-80fd-4d96-8466-ef453c8ba9c3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:53.819723 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d19d3186-80fd-4d96-8466-ef453c8ba9c3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:53.820181 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d19d3186-80fd-4d96-8466-ef453c8ba9c3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:53.820994 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d19d3186-80fd-4d96-8466-ef453c8ba9c3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:53.821446 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d19d3186-80fd-4d96-8466-ef453c8ba9c3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:53.962962 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d19d3186-80fd-4d96-8466-ef453c8ba9c3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:53.971763 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d19d3186-80fd-4d96-8466-ef453c8ba9c3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:53.973595 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d19d3186-80fd-4d96-8466-ef453c8ba9c3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:53.976277 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-d19d3186-80fd-4d96-8466-ef453c8ba9c3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1745 microversion: 2.20 time: 0.169047 May 23 16:49:53.977042 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 204/401] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:53 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:54.518111 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-a56c2d51-5c4f-4894-804e-5a357f43f457 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:54.518993 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-a56c2d51-5c4f-4894-804e-5a357f43f457 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:54.528398 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a56c2d51-5c4f-4894-804e-5a357f43f457 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:54.528398 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a56c2d51-5c4f-4894-804e-5a357f43f457 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:54.528398 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a56c2d51-5c4f-4894-804e-5a357f43f457 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:54.528681 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a56c2d51-5c4f-4894-804e-5a357f43f457 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:54.665555 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-a56c2d51-5c4f-4894-804e-5a357f43f457 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:54.673353 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-a56c2d51-5c4f-4894-804e-5a357f43f457 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 200 len: 1557 microversion: 2.1 time: 0.161740 May 23 16:49:54.681416 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 198/402] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:54 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:54.690967 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a9340287-02fd-4669-a50e-b58d0ee94b80 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:54.691476 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a9340287-02fd-4669-a50e-b58d0ee94b80 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:54.697507 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a9340287-02fd-4669-a50e-b58d0ee94b80 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:54.697960 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a9340287-02fd-4669-a50e-b58d0ee94b80 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:54.698731 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a9340287-02fd-4669-a50e-b58d0ee94b80 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:54.699175 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a9340287-02fd-4669-a50e-b58d0ee94b80 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:54.781570 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a9340287-02fd-4669-a50e-b58d0ee94b80 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095902 May 23 16:49:54.782201 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 205/403] 10.222.0.74 () {58 vars in 1274 bytes} [Mon May 23 16:49:54 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:49:54.995361 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-09fe87f7-6421-473e-9a0f-8249bd0847d7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:55.001693 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-09fe87f7-6421-473e-9a0f-8249bd0847d7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:55.005632 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-09fe87f7-6421-473e-9a0f-8249bd0847d7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:55.006092 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-09fe87f7-6421-473e-9a0f-8249bd0847d7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:55.012147 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-09fe87f7-6421-473e-9a0f-8249bd0847d7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:55.012634 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-09fe87f7-6421-473e-9a0f-8249bd0847d7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:55.273196 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-62d290b5-1a50-4ba6-a745-fc4725637e8c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:49:55.280439 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-62d290b5-1a50-4ba6-a745-fc4725637e8c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:55.281118 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-62d290b5-1a50-4ba6-a745-fc4725637e8c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:55.316649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-09fe87f7-6421-473e-9a0f-8249bd0847d7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:55.327591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-09fe87f7-6421-473e-9a0f-8249bd0847d7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:55.329174 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-09fe87f7-6421-473e-9a0f-8249bd0847d7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:55.334093 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-09fe87f7-6421-473e-9a0f-8249bd0847d7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1740 microversion: 2.20 time: 0.342273 May 23 16:49:55.344439 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 199/404] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:54 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1740 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:55.350901 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-62d290b5-1a50-4ba6-a745-fc4725637e8c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Going to try to stop instance {{(pid=124715) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 23 16:49:55.626538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-62d290b5-1a50-4ba6-a745-fc4725637e8c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "POST /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4/action" status: 202 len: 0 microversion: 2.1 time: 0.359011 May 23 16:49:55.627062 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 206/405] 10.222.0.74 () {60 vars in 1277 bytes} [Mon May 23 16:49:55 2022] POST /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 16:49:55.635504 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ba5354b7-798b-4856-94a6-ae5236b7219c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:55.636330 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ba5354b7-798b-4856-94a6-ae5236b7219c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:55.648765 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ba5354b7-798b-4856-94a6-ae5236b7219c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:55.649491 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ba5354b7-798b-4856-94a6-ae5236b7219c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:55.650546 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ba5354b7-798b-4856-94a6-ae5236b7219c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:55.651802 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ba5354b7-798b-4856-94a6-ae5236b7219c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:55.934864 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ba5354b7-798b-4856-94a6-ae5236b7219c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:55.951841 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ba5354b7-798b-4856-94a6-ae5236b7219c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1723 microversion: 2.1 time: 0.318033 May 23 16:49:55.967730 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 200/406] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:55 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1723 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:49:56.201415 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-b58e38b2-b349-43f3-b133-312f2220ae1e req-ac55e3c6-77c1-4c23-8625-c87df1235ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d413ebb5-7e19-40ba-810b-505e89c582ef", "tag": "f53be2ff-ed66-407e-961f-9ac93b76ebe4"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:49:56.242452 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-b58e38b2-b349-43f3-b133-312f2220ae1e req-ac55e3c6-77c1-4c23-8625-c87df1235ab3 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:56.243783 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-b58e38b2-b349-43f3-b133-312f2220ae1e req-ac55e3c6-77c1-4c23-8625-c87df1235ab3 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:56.262890 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-b58e38b2-b349-43f3-b133-312f2220ae1e req-ac55e3c6-77c1-4c23-8625-c87df1235ab3 service nova] Creating event network-changed:f53be2ff-ed66-407e-961f-9ac93b76ebe4 for instance d413ebb5-7e19-40ba-810b-505e89c582ef on hv-cinder-83925 May 23 16:49:56.270103 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-b58e38b2-b349-43f3-b133-312f2220ae1e req-ac55e3c6-77c1-4c23-8625-c87df1235ab3 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073127 May 23 16:49:56.271447 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 207/407] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:49:56.364098 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-e199a885-6e4a-4c6b-8695-213f347a5a66 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:56.365101 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-e199a885-6e4a-4c6b-8695-213f347a5a66 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:56.378657 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e199a885-6e4a-4c6b-8695-213f347a5a66 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:56.382037 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e199a885-6e4a-4c6b-8695-213f347a5a66 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:56.383080 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e199a885-6e4a-4c6b-8695-213f347a5a66 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:56.383945 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e199a885-6e4a-4c6b-8695-213f347a5a66 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:56.613568 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e199a885-6e4a-4c6b-8695-213f347a5a66 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:56.622049 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e199a885-6e4a-4c6b-8695-213f347a5a66 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:56.623976 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e199a885-6e4a-4c6b-8695-213f347a5a66 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:56.625184 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-e199a885-6e4a-4c6b-8695-213f347a5a66 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1740 microversion: 2.20 time: 0.266093 May 23 16:49:56.638125 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 201/408] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:56 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1740 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:56.971956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-df9f5150-8457-4c03-be7d-c0e433541182 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:56.972816 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-df9f5150-8457-4c03-be7d-c0e433541182 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:56.980775 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-df9f5150-8457-4c03-be7d-c0e433541182 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:56.981518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-df9f5150-8457-4c03-be7d-c0e433541182 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:56.983979 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-df9f5150-8457-4c03-be7d-c0e433541182 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:56.984684 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-df9f5150-8457-4c03-be7d-c0e433541182 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:56.994913 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:49:57.188819 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-df9f5150-8457-4c03-be7d-c0e433541182 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:57.202748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-df9f5150-8457-4c03-be7d-c0e433541182 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1723 microversion: 2.1 time: 0.235965 May 23 16:49:57.213242 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 208/409] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:56 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:57.650797 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-d81b7b2c-0413-44d4-bb8d-57221a59b0cc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:57.651410 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-d81b7b2c-0413-44d4-bb8d-57221a59b0cc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:57.663556 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d81b7b2c-0413-44d4-bb8d-57221a59b0cc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:57.664001 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d81b7b2c-0413-44d4-bb8d-57221a59b0cc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:57.664798 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d81b7b2c-0413-44d4-bb8d-57221a59b0cc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:57.665234 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d81b7b2c-0413-44d4-bb8d-57221a59b0cc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:57.826162 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-d81b7b2c-0413-44d4-bb8d-57221a59b0cc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:57.841330 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-d81b7b2c-0413-44d4-bb8d-57221a59b0cc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:57.843409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-d81b7b2c-0413-44d4-bb8d-57221a59b0cc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:57.844940 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-d81b7b2c-0413-44d4-bb8d-57221a59b0cc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1740 microversion: 2.20 time: 0.202033 May 23 16:49:57.855917 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 202/410] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:57 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1740 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:58.223463 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-0c86c064-a2f9-475a-b906-a12c9382ff40 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:58.224087 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-0c86c064-a2f9-475a-b906-a12c9382ff40 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:58.230907 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0c86c064-a2f9-475a-b906-a12c9382ff40 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:58.231359 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0c86c064-a2f9-475a-b906-a12c9382ff40 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:58.232134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0c86c064-a2f9-475a-b906-a12c9382ff40 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:58.232853 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0c86c064-a2f9-475a-b906-a12c9382ff40 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:58.372128 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-0c86c064-a2f9-475a-b906-a12c9382ff40 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:58.381592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-0c86c064-a2f9-475a-b906-a12c9382ff40 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1723 microversion: 2.1 time: 0.164709 May 23 16:49:58.382174 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 209/411] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:58 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:49:58.863304 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-7f5a6ba9-76aa-4bf6-a5e1-b5f035d51318 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:58.864565 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-7f5a6ba9-76aa-4bf6-a5e1-b5f035d51318 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:58.873410 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7f5a6ba9-76aa-4bf6-a5e1-b5f035d51318 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:58.873986 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7f5a6ba9-76aa-4bf6-a5e1-b5f035d51318 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:58.874763 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7f5a6ba9-76aa-4bf6-a5e1-b5f035d51318 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:58.875199 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7f5a6ba9-76aa-4bf6-a5e1-b5f035d51318 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:59.020860 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7f5a6ba9-76aa-4bf6-a5e1-b5f035d51318 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:59.030448 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7f5a6ba9-76aa-4bf6-a5e1-b5f035d51318 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:59.032270 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7f5a6ba9-76aa-4bf6-a5e1-b5f035d51318 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:59.033865 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-7f5a6ba9-76aa-4bf6-a5e1-b5f035d51318 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1740 microversion: 2.20 time: 0.174547 May 23 16:49:59.034438 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 203/412] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:49:58 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:49:59.399132 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-3e284053-be32-4408-9fab-2b17bdebe3db tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:49:59.399918 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-3e284053-be32-4408-9fab-2b17bdebe3db tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:49:59.407835 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3e284053-be32-4408-9fab-2b17bdebe3db tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:59.408405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3e284053-be32-4408-9fab-2b17bdebe3db tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:59.409249 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3e284053-be32-4408-9fab-2b17bdebe3db tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:49:59.409892 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3e284053-be32-4408-9fab-2b17bdebe3db tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:49:59.550012 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-3e284053-be32-4408-9fab-2b17bdebe3db tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:49:59.558094 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-3e284053-be32-4408-9fab-2b17bdebe3db tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1723 microversion: 2.1 time: 0.163055 May 23 16:49:59.558971 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 210/413] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:49:59 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:00.052704 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-279f04e0-6c5c-41c7-916d-13643db86d4e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:00.054113 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-279f04e0-6c5c-41c7-916d-13643db86d4e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:00.061176 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-279f04e0-6c5c-41c7-916d-13643db86d4e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:00.061650 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-279f04e0-6c5c-41c7-916d-13643db86d4e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:00.062609 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-279f04e0-6c5c-41c7-916d-13643db86d4e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:00.063264 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-279f04e0-6c5c-41c7-916d-13643db86d4e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:00.243192 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-279f04e0-6c5c-41c7-916d-13643db86d4e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:00.257127 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-279f04e0-6c5c-41c7-916d-13643db86d4e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:00.259107 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-279f04e0-6c5c-41c7-916d-13643db86d4e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:00.260701 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-279f04e0-6c5c-41c7-916d-13643db86d4e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1740 microversion: 2.20 time: 0.211957 May 23 16:50:00.261567 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 204/414] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:00 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:50:00.578608 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7413e282-c931-4fda-8ba5-3418e90000bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:00.580099 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-7413e282-c931-4fda-8ba5-3418e90000bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:00.587019 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7413e282-c931-4fda-8ba5-3418e90000bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:00.587684 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7413e282-c931-4fda-8ba5-3418e90000bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:00.588806 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7413e282-c931-4fda-8ba5-3418e90000bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:00.589247 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7413e282-c931-4fda-8ba5-3418e90000bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:00.738959 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-7413e282-c931-4fda-8ba5-3418e90000bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:00.747887 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-7413e282-c931-4fda-8ba5-3418e90000bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1723 microversion: 2.1 time: 0.173776 May 23 16:50:00.749250 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 211/415] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:00 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:01.280062 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-95fa2c59-2a56-4e8a-b000-ce400692a5e9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:01.280851 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-95fa2c59-2a56-4e8a-b000-ce400692a5e9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:01.287914 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-95fa2c59-2a56-4e8a-b000-ce400692a5e9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:01.288392 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-95fa2c59-2a56-4e8a-b000-ce400692a5e9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:01.289236 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-95fa2c59-2a56-4e8a-b000-ce400692a5e9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:01.289698 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-95fa2c59-2a56-4e8a-b000-ce400692a5e9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:01.437238 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-95fa2c59-2a56-4e8a-b000-ce400692a5e9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:01.441437 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:50:01.463294 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-95fa2c59-2a56-4e8a-b000-ce400692a5e9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:01.464998 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-95fa2c59-2a56-4e8a-b000-ce400692a5e9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:01.466221 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-95fa2c59-2a56-4e8a-b000-ce400692a5e9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1740 microversion: 2.20 time: 0.191007 May 23 16:50:01.467248 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 205/416] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:01 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:01.765991 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a32824bd-d824-4479-889c-30ac429832f0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:01.766675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a32824bd-d824-4479-889c-30ac429832f0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:01.773223 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a32824bd-d824-4479-889c-30ac429832f0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:01.773680 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a32824bd-d824-4479-889c-30ac429832f0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:01.774451 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a32824bd-d824-4479-889c-30ac429832f0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:01.774894 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a32824bd-d824-4479-889c-30ac429832f0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:01.921995 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a32824bd-d824-4479-889c-30ac429832f0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:01.932782 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a32824bd-d824-4479-889c-30ac429832f0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1723 microversion: 2.1 time: 0.170464 May 23 16:50:01.933542 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 212/417] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:01 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:02.485515 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-7be0deea-7e42-4a51-a571-9a52640ed6ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:02.486124 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-7be0deea-7e42-4a51-a571-9a52640ed6ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:02.494892 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7be0deea-7e42-4a51-a571-9a52640ed6ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:02.495418 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7be0deea-7e42-4a51-a571-9a52640ed6ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:02.496346 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7be0deea-7e42-4a51-a571-9a52640ed6ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:02.497371 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7be0deea-7e42-4a51-a571-9a52640ed6ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:02.685053 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7be0deea-7e42-4a51-a571-9a52640ed6ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:02.698546 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7be0deea-7e42-4a51-a571-9a52640ed6ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:02.700127 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7be0deea-7e42-4a51-a571-9a52640ed6ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:02.702755 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-7be0deea-7e42-4a51-a571-9a52640ed6ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1740 microversion: 2.20 time: 0.220764 May 23 16:50:02.703901 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 206/418] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:02 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:02.765904 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a60fe12e-360b-49b7-8acf-3fc8e3de4856 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:02.766577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a60fe12e-360b-49b7-8acf-3fc8e3de4856 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:02.774376 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a60fe12e-360b-49b7-8acf-3fc8e3de4856 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:02.777753 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a60fe12e-360b-49b7-8acf-3fc8e3de4856 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:02.777753 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a60fe12e-360b-49b7-8acf-3fc8e3de4856 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:02.777753 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a60fe12e-360b-49b7-8acf-3fc8e3de4856 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:02.951205 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-d8415b59-3ac6-49ba-8ca4-ce76b4d3017f tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:02.951943 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-d8415b59-3ac6-49ba-8ca4-ce76b4d3017f tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:02.966437 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d8415b59-3ac6-49ba-8ca4-ce76b4d3017f tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:02.967017 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d8415b59-3ac6-49ba-8ca4-ce76b4d3017f tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:02.968494 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d8415b59-3ac6-49ba-8ca4-ce76b4d3017f tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:02.969636 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d8415b59-3ac6-49ba-8ca4-ce76b4d3017f tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:03.237979 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a60fe12e-360b-49b7-8acf-3fc8e3de4856 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:03.248348 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a60fe12e-360b-49b7-8acf-3fc8e3de4856 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1594 microversion: 2.1 time: 0.486618 May 23 16:50:03.248923 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 213/419] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:02 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1594 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:03.316076 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-d8415b59-3ac6-49ba-8ca4-ce76b4d3017f tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:03.328673 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-d8415b59-3ac6-49ba-8ca4-ce76b4d3017f tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1723 microversion: 2.1 time: 0.377374 May 23 16:50:03.329284 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 207/420] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:02 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1723 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:03.722646 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-502285dd-d6a5-4e78-857c-7d918ffaf1e5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:03.723267 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-502285dd-d6a5-4e78-857c-7d918ffaf1e5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:03.731986 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-502285dd-d6a5-4e78-857c-7d918ffaf1e5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:03.732871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-502285dd-d6a5-4e78-857c-7d918ffaf1e5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:03.735409 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-502285dd-d6a5-4e78-857c-7d918ffaf1e5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:03.736024 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-502285dd-d6a5-4e78-857c-7d918ffaf1e5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:03.941265 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-502285dd-d6a5-4e78-857c-7d918ffaf1e5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:03.950092 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-502285dd-d6a5-4e78-857c-7d918ffaf1e5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:03.951814 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-502285dd-d6a5-4e78-857c-7d918ffaf1e5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:03.953314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-502285dd-d6a5-4e78-857c-7d918ffaf1e5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1740 microversion: 2.20 time: 0.235528 May 23 16:50:03.964601 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 214/421] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:03 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1740 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:04.347092 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-9aef0061-edc1-4dd9-af14-6b7c8189a15a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:04.348840 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-9aef0061-edc1-4dd9-af14-6b7c8189a15a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:04.360623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9aef0061-edc1-4dd9-af14-6b7c8189a15a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:04.361252 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9aef0061-edc1-4dd9-af14-6b7c8189a15a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:04.362401 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9aef0061-edc1-4dd9-af14-6b7c8189a15a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:04.363028 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9aef0061-edc1-4dd9-af14-6b7c8189a15a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:04.519002 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-9aef0061-edc1-4dd9-af14-6b7c8189a15a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:04.531096 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-9aef0061-edc1-4dd9-af14-6b7c8189a15a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1723 microversion: 2.1 time: 0.188009 May 23 16:50:04.532281 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 208/422] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:04 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:04.973085 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a188e9c7-5b46-47cc-ba5d-3f95c5a356fe tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:04.973646 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a188e9c7-5b46-47cc-ba5d-3f95c5a356fe tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:04.980072 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a188e9c7-5b46-47cc-ba5d-3f95c5a356fe tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:04.980563 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a188e9c7-5b46-47cc-ba5d-3f95c5a356fe tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:04.981331 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a188e9c7-5b46-47cc-ba5d-3f95c5a356fe tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:04.981776 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a188e9c7-5b46-47cc-ba5d-3f95c5a356fe tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:05.134136 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a188e9c7-5b46-47cc-ba5d-3f95c5a356fe tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:05.146581 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a188e9c7-5b46-47cc-ba5d-3f95c5a356fe tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:05.148779 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a188e9c7-5b46-47cc-ba5d-3f95c5a356fe tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:05.149961 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a188e9c7-5b46-47cc-ba5d-3f95c5a356fe tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1740 microversion: 2.20 time: 0.181026 May 23 16:50:05.150762 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 215/423] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:04 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:05.549276 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ead2ac58-ce74-4404-97fb-c6b8b88181cd tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:05.550519 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ead2ac58-ce74-4404-97fb-c6b8b88181cd tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:05.557410 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ead2ac58-ce74-4404-97fb-c6b8b88181cd tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:05.558020 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ead2ac58-ce74-4404-97fb-c6b8b88181cd tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:05.558806 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ead2ac58-ce74-4404-97fb-c6b8b88181cd tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:05.559249 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ead2ac58-ce74-4404-97fb-c6b8b88181cd tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:05.746333 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ead2ac58-ce74-4404-97fb-c6b8b88181cd tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:05.756096 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ead2ac58-ce74-4404-97fb-c6b8b88181cd tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1723 microversion: 2.1 time: 0.211235 May 23 16:50:05.757031 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 209/424] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:05 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:06.099224 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-b2df1cc6-3862-4ddf-b490-5c4ba65b2a8e req-0551d994-033a-4ff1-84ba-7d52ff9eeed0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e337be75-f64c-4c86-97f1-e31cf55a6089", "tag": "5141686c-093d-45da-8646-a43dcece1e63"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:50:06.105075 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=68 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:50:06.125961 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-b2df1cc6-3862-4ddf-b490-5c4ba65b2a8e req-0551d994-033a-4ff1-84ba-7d52ff9eeed0 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:06.133204 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-b2df1cc6-3862-4ddf-b490-5c4ba65b2a8e req-0551d994-033a-4ff1-84ba-7d52ff9eeed0 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:06.151797 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-b2df1cc6-3862-4ddf-b490-5c4ba65b2a8e req-0551d994-033a-4ff1-84ba-7d52ff9eeed0 service nova] Creating event network-changed:5141686c-093d-45da-8646-a43dcece1e63 for instance e337be75-f64c-4c86-97f1-e31cf55a6089 on hv-cinder-83925 May 23 16:50:06.159034 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-b2df1cc6-3862-4ddf-b490-5c4ba65b2a8e req-0551d994-033a-4ff1-84ba-7d52ff9eeed0 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063653 May 23 16:50:06.162259 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 216/425] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:50:06.175453 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-8ebe7e34-2180-41f6-bc07-e6ee57262ed8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:06.176235 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-8ebe7e34-2180-41f6-bc07-e6ee57262ed8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:06.183610 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8ebe7e34-2180-41f6-bc07-e6ee57262ed8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:06.184473 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8ebe7e34-2180-41f6-bc07-e6ee57262ed8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:06.185715 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8ebe7e34-2180-41f6-bc07-e6ee57262ed8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:06.186382 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8ebe7e34-2180-41f6-bc07-e6ee57262ed8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:06.466992 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8ebe7e34-2180-41f6-bc07-e6ee57262ed8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:06.476253 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8ebe7e34-2180-41f6-bc07-e6ee57262ed8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:06.478023 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8ebe7e34-2180-41f6-bc07-e6ee57262ed8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:06.479201 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-8ebe7e34-2180-41f6-bc07-e6ee57262ed8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1740 microversion: 2.20 time: 0.312276 May 23 16:50:06.479924 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 210/426] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:06 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1740 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:06.774084 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a7bfecec-7bd5-4e06-947b-65bfe3c999f8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:06.775040 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a7bfecec-7bd5-4e06-947b-65bfe3c999f8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:06.782619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a7bfecec-7bd5-4e06-947b-65bfe3c999f8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:06.785305 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a7bfecec-7bd5-4e06-947b-65bfe3c999f8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:06.785305 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a7bfecec-7bd5-4e06-947b-65bfe3c999f8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:06.785305 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a7bfecec-7bd5-4e06-947b-65bfe3c999f8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:07.003329 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a7bfecec-7bd5-4e06-947b-65bfe3c999f8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:07.007748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a7bfecec-7bd5-4e06-947b-65bfe3c999f8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1723 microversion: 2.1 time: 0.237816 May 23 16:50:07.008434 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 217/427] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:06 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:07.500935 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-da2b63d6-a405-48a7-a21d-b7cdfa443fce tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:07.501568 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-da2b63d6-a405-48a7-a21d-b7cdfa443fce tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:07.503865 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=76 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:50:07.508680 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-da2b63d6-a405-48a7-a21d-b7cdfa443fce tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:07.509137 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-da2b63d6-a405-48a7-a21d-b7cdfa443fce tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:07.509985 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-da2b63d6-a405-48a7-a21d-b7cdfa443fce tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:07.510430 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-da2b63d6-a405-48a7-a21d-b7cdfa443fce tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:07.682036 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-da2b63d6-a405-48a7-a21d-b7cdfa443fce tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:07.690578 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-da2b63d6-a405-48a7-a21d-b7cdfa443fce tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:07.692130 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-da2b63d6-a405-48a7-a21d-b7cdfa443fce tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:07.693335 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-da2b63d6-a405-48a7-a21d-b7cdfa443fce tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1722 microversion: 2.20 time: 0.198427 May 23 16:50:07.693937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 211/428] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:07 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:08.026936 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-30d1985d-1fb9-4266-ad1a-57257d890e6d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:08.027555 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-30d1985d-1fb9-4266-ad1a-57257d890e6d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:08.034033 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30d1985d-1fb9-4266-ad1a-57257d890e6d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:08.034497 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30d1985d-1fb9-4266-ad1a-57257d890e6d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:08.035275 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30d1985d-1fb9-4266-ad1a-57257d890e6d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:08.035726 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30d1985d-1fb9-4266-ad1a-57257d890e6d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:08.236461 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-30d1985d-1fb9-4266-ad1a-57257d890e6d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:08.244448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-30d1985d-1fb9-4266-ad1a-57257d890e6d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1723 microversion: 2.1 time: 0.221445 May 23 16:50:08.245013 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 218/429] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:08 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:08.714835 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-cd851415-f1df-4ec4-9d3d-817a35fb3d80 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:08.715402 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-cd851415-f1df-4ec4-9d3d-817a35fb3d80 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:08.722489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cd851415-f1df-4ec4-9d3d-817a35fb3d80 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:08.722949 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cd851415-f1df-4ec4-9d3d-817a35fb3d80 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:08.723723 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cd851415-f1df-4ec4-9d3d-817a35fb3d80 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:08.724160 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cd851415-f1df-4ec4-9d3d-817a35fb3d80 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:08.826940 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-760c329b-8b66-4299-8ad6-193e2c6718e3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1375700589"}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:50:08.827481 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-760c329b-8b66-4299-8ad6-193e2c6718e3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:08.833825 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-760c329b-8b66-4299-8ad6-193e2c6718e3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:08.834254 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-760c329b-8b66-4299-8ad6-193e2c6718e3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:08.835016 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-760c329b-8b66-4299-8ad6-193e2c6718e3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:08.835515 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-760c329b-8b66-4299-8ad6-193e2c6718e3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:08.853069 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-cd851415-f1df-4ec4-9d3d-817a35fb3d80 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:08.863303 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-cd851415-f1df-4ec4-9d3d-817a35fb3d80 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:08.864986 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-cd851415-f1df-4ec4-9d3d-817a35fb3d80 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:08.866325 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-cd851415-f1df-4ec4-9d3d-817a35fb3d80 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1722 microversion: 2.20 time: 0.155548 May 23 16:50:08.869477 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 212/430] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:08 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:08.963754 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.network.security_group_api [None req-760c329b-8b66-4299-8ad6-193e2c6718e3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Adding security group 120eca0c-f193-4e4f-a405-6d8ad7a2cf9d to port 5141686c-093d-45da-8646-a43dcece1e63 May 23 16:50:09.262403 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-95be44ef-139d-4f70-85f6-fcec169839d4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:09.263026 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-95be44ef-139d-4f70-85f6-fcec169839d4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:09.269661 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-95be44ef-139d-4f70-85f6-fcec169839d4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:09.270125 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-95be44ef-139d-4f70-85f6-fcec169839d4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:09.270917 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-95be44ef-139d-4f70-85f6-fcec169839d4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:09.271362 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-95be44ef-139d-4f70-85f6-fcec169839d4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:09.410409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-95be44ef-139d-4f70-85f6-fcec169839d4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:09.418320 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-95be44ef-139d-4f70-85f6-fcec169839d4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1723 microversion: 2.1 time: 0.159974 May 23 16:50:09.418891 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 213/431] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:09 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:09.467455 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-760c329b-8b66-4299-8ad6-193e2c6718e3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "POST /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089/action" status: 202 len: 0 microversion: 2.1 time: 0.644420 May 23 16:50:09.471351 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 219/432] 10.222.0.74 () {60 vars in 1277 bytes} [Mon May 23 16:50:08 2022] POST /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089/action => generated 0 bytes in 649 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 16:50:09.479559 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-e75d8a2d-4c71-4310-80a7-162337da3cbe tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:09.486597 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-2c4c597a-78ed-47ad-a1da-db100c37ca6c req-71e5ed7e-368c-4f15-910b-3437bf0c75bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e337be75-f64c-4c86-97f1-e31cf55a6089", "tag": "5141686c-093d-45da-8646-a43dcece1e63"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:50:09.491087 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-e75d8a2d-4c71-4310-80a7-162337da3cbe tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:09.503441 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-2c4c597a-78ed-47ad-a1da-db100c37ca6c req-71e5ed7e-368c-4f15-910b-3437bf0c75bb service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:09.505144 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e75d8a2d-4c71-4310-80a7-162337da3cbe tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:09.505796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e75d8a2d-4c71-4310-80a7-162337da3cbe tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:09.506447 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-2c4c597a-78ed-47ad-a1da-db100c37ca6c req-71e5ed7e-368c-4f15-910b-3437bf0c75bb service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:09.507449 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e75d8a2d-4c71-4310-80a7-162337da3cbe tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:09.512287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e75d8a2d-4c71-4310-80a7-162337da3cbe tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:09.530531 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-2c4c597a-78ed-47ad-a1da-db100c37ca6c req-71e5ed7e-368c-4f15-910b-3437bf0c75bb service nova] Creating event network-changed:5141686c-093d-45da-8646-a43dcece1e63 for instance e337be75-f64c-4c86-97f1-e31cf55a6089 on hv-cinder-83925 May 23 16:50:09.536825 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-2c4c597a-78ed-47ad-a1da-db100c37ca6c req-71e5ed7e-368c-4f15-910b-3437bf0c75bb service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055551 May 23 16:50:09.538093 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 220/433] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:50:09.684859 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e75d8a2d-4c71-4310-80a7-162337da3cbe tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:09.693710 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-e75d8a2d-4c71-4310-80a7-162337da3cbe tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1760 microversion: 2.1 time: 0.217994 May 23 16:50:09.694295 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 214/434] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:09 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1760 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:09.886660 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-31c938d7-f0f5-4eff-a42e-857549d23154 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:09.887411 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-31c938d7-f0f5-4eff-a42e-857549d23154 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:09.894221 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-31c938d7-f0f5-4eff-a42e-857549d23154 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:09.894674 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-31c938d7-f0f5-4eff-a42e-857549d23154 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:09.895836 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-31c938d7-f0f5-4eff-a42e-857549d23154 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:09.896290 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-31c938d7-f0f5-4eff-a42e-857549d23154 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:10.054385 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-0f7a18bc-59a7-4bc8-a5ec-851b40800bec req-43f25d51-095a-4860-8fa9-4cb9fd611ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb302c29-c30d-4ffa-af9d-1f226fd56357", "name": "network-vif-unplugged", "status": "completed", "tag": "bd409a76-162e-44c7-9e54-76b5e47accda"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:50:10.065030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-0f7a18bc-59a7-4bc8-a5ec-851b40800bec req-43f25d51-095a-4860-8fa9-4cb9fd611ff5 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:10.065496 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-0f7a18bc-59a7-4bc8-a5ec-851b40800bec req-43f25d51-095a-4860-8fa9-4cb9fd611ff5 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:10.077201 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-0f7a18bc-59a7-4bc8-a5ec-851b40800bec req-43f25d51-095a-4860-8fa9-4cb9fd611ff5 service nova] Creating event network-vif-unplugged:bd409a76-162e-44c7-9e54-76b5e47accda for instance bb302c29-c30d-4ffa-af9d-1f226fd56357 on hv-cinder-83925 May 23 16:50:10.083308 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-0f7a18bc-59a7-4bc8-a5ec-851b40800bec req-43f25d51-095a-4860-8fa9-4cb9fd611ff5 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032738 May 23 16:50:10.083988 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 215/435] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:50:10.092559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-31c938d7-f0f5-4eff-a42e-857549d23154 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:10.102562 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-31c938d7-f0f5-4eff-a42e-857549d23154 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:10.104187 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-31c938d7-f0f5-4eff-a42e-857549d23154 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:10.105395 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-31c938d7-f0f5-4eff-a42e-857549d23154 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1722 microversion: 2.20 time: 0.224337 May 23 16:50:10.106321 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 221/436] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:09 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:10.439956 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-cc6831fc-be2c-4fd4-a587-6514b77b538c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:10.440874 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-cc6831fc-be2c-4fd4-a587-6514b77b538c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:10.447541 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cc6831fc-be2c-4fd4-a587-6514b77b538c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:10.447993 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cc6831fc-be2c-4fd4-a587-6514b77b538c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:10.456112 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cc6831fc-be2c-4fd4-a587-6514b77b538c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:10.456112 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cc6831fc-be2c-4fd4-a587-6514b77b538c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:10.599589 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-cc6831fc-be2c-4fd4-a587-6514b77b538c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:10.607601 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-cc6831fc-be2c-4fd4-a587-6514b77b538c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1723 microversion: 2.1 time: 0.174805 May 23 16:50:10.608182 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 216/437] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:10 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:11.125221 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-341412cd-d7d4-4377-aa00-266db212bd61 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:11.126775 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-341412cd-d7d4-4377-aa00-266db212bd61 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:11.132871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-341412cd-d7d4-4377-aa00-266db212bd61 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:11.133320 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-341412cd-d7d4-4377-aa00-266db212bd61 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:11.134081 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-341412cd-d7d4-4377-aa00-266db212bd61 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:11.134518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-341412cd-d7d4-4377-aa00-266db212bd61 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:11.261777 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-341412cd-d7d4-4377-aa00-266db212bd61 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:11.270886 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-341412cd-d7d4-4377-aa00-266db212bd61 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:11.272749 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-341412cd-d7d4-4377-aa00-266db212bd61 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:11.273944 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-341412cd-d7d4-4377-aa00-266db212bd61 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1665 microversion: 2.20 time: 0.152738 May 23 16:50:11.274501 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 222/438] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:11 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:11.291762 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-8e20843c-8dc4-43f5-a1ca-65ea701667fa tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fad954f-3792-459b-bd53-fa13fe7de3d6"}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:50:11.292932 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-8e20843c-8dc4-43f5-a1ca-65ea701667fa tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:11.300621 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8e20843c-8dc4-43f5-a1ca-65ea701667fa tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:11.301078 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8e20843c-8dc4-43f5-a1ca-65ea701667fa tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:11.301850 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8e20843c-8dc4-43f5-a1ca-65ea701667fa tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:11.302294 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8e20843c-8dc4-43f5-a1ca-65ea701667fa tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:11.625472 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-b925675a-8614-4560-82d8-137dd234ecb8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:11.626102 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-b925675a-8614-4560-82d8-137dd234ecb8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:11.632105 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b925675a-8614-4560-82d8-137dd234ecb8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:11.632591 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b925675a-8614-4560-82d8-137dd234ecb8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:11.633357 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b925675a-8614-4560-82d8-137dd234ecb8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:11.633793 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b925675a-8614-4560-82d8-137dd234ecb8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:11.761481 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-b925675a-8614-4560-82d8-137dd234ecb8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:11.769802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-b925675a-8614-4560-82d8-137dd234ecb8 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1723 microversion: 2.1 time: 0.148427 May 23 16:50:11.770370 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 223/439] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:11 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:50:12.250474 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-8e20843c-8dc4-43f5-a1ca-65ea701667fa tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "POST /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.962561 May 23 16:50:12.251266 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 217/440] 10.222.0.74 () {62 vars in 1363 bytes} [Mon May 23 16:50:11 2022] POST /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357/os-volume_attachments => generated 188 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 16:50:12.371418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-b75b0948-61e5-4075-bc99-4053ee34e5c6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:50:12.372023 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-b75b0948-61e5-4075-bc99-4053ee34e5c6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:12.378577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b75b0948-61e5-4075-bc99-4053ee34e5c6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:12.379041 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b75b0948-61e5-4075-bc99-4053ee34e5c6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:12.379806 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b75b0948-61e5-4075-bc99-4053ee34e5c6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:12.380248 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b75b0948-61e5-4075-bc99-4053ee34e5c6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:12.612332 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-b75b0948-61e5-4075-bc99-4053ee34e5c6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "POST /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357/action" status: 202 len: 0 microversion: 2.20 time: 0.244688 May 23 16:50:12.613088 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 224/441] 10.222.0.74 () {62 vars in 1318 bytes} [Mon May 23 16:50:12 2022] POST /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 16:50:12.621262 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-44f3c0a4-2ed8-48e7-82c2-a3d9367f9f9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:12.621895 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-44f3c0a4-2ed8-48e7-82c2-a3d9367f9f9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:12.630140 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-44f3c0a4-2ed8-48e7-82c2-a3d9367f9f9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:12.630598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-44f3c0a4-2ed8-48e7-82c2-a3d9367f9f9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:12.631382 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-44f3c0a4-2ed8-48e7-82c2-a3d9367f9f9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:12.631828 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-44f3c0a4-2ed8-48e7-82c2-a3d9367f9f9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:12.764426 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-44f3c0a4-2ed8-48e7-82c2-a3d9367f9f9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:12.773461 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-44f3c0a4-2ed8-48e7-82c2-a3d9367f9f9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:12.775008 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-44f3c0a4-2ed8-48e7-82c2-a3d9367f9f9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:12.776223 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-44f3c0a4-2ed8-48e7-82c2-a3d9367f9f9e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1751 microversion: 2.20 time: 0.159138 May 23 16:50:12.779574 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 218/442] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:12 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:12.788135 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-12b25c66-9098-4dd1-9a25-d767d6ceb2e5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:12.789034 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-12b25c66-9098-4dd1-9a25-d767d6ceb2e5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:12.795737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-12b25c66-9098-4dd1-9a25-d767d6ceb2e5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:12.796188 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-12b25c66-9098-4dd1-9a25-d767d6ceb2e5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:12.797054 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-12b25c66-9098-4dd1-9a25-d767d6ceb2e5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:12.798073 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-12b25c66-9098-4dd1-9a25-d767d6ceb2e5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:12.817053 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:50:12.931168 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-12b25c66-9098-4dd1-9a25-d767d6ceb2e5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:12.940573 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-12b25c66-9098-4dd1-9a25-d767d6ceb2e5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1723 microversion: 2.1 time: 0.157289 May 23 16:50:12.943904 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 225/443] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:12 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:50:13.795232 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ee5c9aba-ad2b-4222-833e-e299145f3039 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:13.795991 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ee5c9aba-ad2b-4222-833e-e299145f3039 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:13.803531 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ee5c9aba-ad2b-4222-833e-e299145f3039 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:13.803991 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ee5c9aba-ad2b-4222-833e-e299145f3039 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:13.805746 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ee5c9aba-ad2b-4222-833e-e299145f3039 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:13.806371 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ee5c9aba-ad2b-4222-833e-e299145f3039 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:13.942773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ee5c9aba-ad2b-4222-833e-e299145f3039 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:13.951300 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ee5c9aba-ad2b-4222-833e-e299145f3039 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:13.953260 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ee5c9aba-ad2b-4222-833e-e299145f3039 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:13.954603 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ee5c9aba-ad2b-4222-833e-e299145f3039 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1751 microversion: 2.20 time: 0.163329 May 23 16:50:13.955167 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 219/444] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:13 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:13.957862 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-b59f9c29-dc1c-4319-b507-911a452ea535 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:13.958681 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-b59f9c29-dc1c-4319-b507-911a452ea535 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:13.965632 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b59f9c29-dc1c-4319-b507-911a452ea535 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:13.968429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b59f9c29-dc1c-4319-b507-911a452ea535 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:13.968429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b59f9c29-dc1c-4319-b507-911a452ea535 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:13.968429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b59f9c29-dc1c-4319-b507-911a452ea535 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:14.094275 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-b59f9c29-dc1c-4319-b507-911a452ea535 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:14.103198 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-b59f9c29-dc1c-4319-b507-911a452ea535 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1723 microversion: 2.1 time: 0.150138 May 23 16:50:14.103776 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 226/445] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:13 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:50:14.973404 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-43cec6e4-a0b7-43eb-a849-327dbdb5db4a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:14.974969 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-43cec6e4-a0b7-43eb-a849-327dbdb5db4a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:14.980837 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-43cec6e4-a0b7-43eb-a849-327dbdb5db4a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:14.981297 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-43cec6e4-a0b7-43eb-a849-327dbdb5db4a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:14.982076 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-43cec6e4-a0b7-43eb-a849-327dbdb5db4a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:14.982759 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-43cec6e4-a0b7-43eb-a849-327dbdb5db4a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:15.002096 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:50:15.118042 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-43cec6e4-a0b7-43eb-a849-327dbdb5db4a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:15.120857 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-64bd7808-c561-45dc-b8c7-82845e1d913a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:15.121503 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-64bd7808-c561-45dc-b8c7-82845e1d913a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:15.127379 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-43cec6e4-a0b7-43eb-a849-327dbdb5db4a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:15.129076 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-43cec6e4-a0b7-43eb-a849-327dbdb5db4a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:15.129223 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-64bd7808-c561-45dc-b8c7-82845e1d913a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:15.129663 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-64bd7808-c561-45dc-b8c7-82845e1d913a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:15.130484 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-64bd7808-c561-45dc-b8c7-82845e1d913a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:15.130603 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-43cec6e4-a0b7-43eb-a849-327dbdb5db4a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1753 microversion: 2.20 time: 0.161951 May 23 16:50:15.130930 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-64bd7808-c561-45dc-b8c7-82845e1d913a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:15.131066 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 220/446] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:14 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:50:15.260967 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-64bd7808-c561-45dc-b8c7-82845e1d913a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:15.268942 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-64bd7808-c561-45dc-b8c7-82845e1d913a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1723 microversion: 2.1 time: 0.152255 May 23 16:50:15.269508 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 227/447] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:15 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:16.149842 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-12661eab-f791-4a89-81a8-4c2c0349a970 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:16.150619 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-12661eab-f791-4a89-81a8-4c2c0349a970 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:16.158705 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-12661eab-f791-4a89-81a8-4c2c0349a970 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:16.159224 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-12661eab-f791-4a89-81a8-4c2c0349a970 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:16.160061 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-12661eab-f791-4a89-81a8-4c2c0349a970 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:16.160614 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-12661eab-f791-4a89-81a8-4c2c0349a970 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:16.286146 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-790b24cc-67e4-4ae8-bcfa-00aa8e06763f tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:16.286882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-790b24cc-67e4-4ae8-bcfa-00aa8e06763f tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:16.294139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-790b24cc-67e4-4ae8-bcfa-00aa8e06763f tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:16.294592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-790b24cc-67e4-4ae8-bcfa-00aa8e06763f tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:16.295369 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-790b24cc-67e4-4ae8-bcfa-00aa8e06763f tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:16.295804 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-790b24cc-67e4-4ae8-bcfa-00aa8e06763f tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:16.674778 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-12661eab-f791-4a89-81a8-4c2c0349a970 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:16.683153 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-12661eab-f791-4a89-81a8-4c2c0349a970 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:16.684685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-12661eab-f791-4a89-81a8-4c2c0349a970 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:16.685844 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-12661eab-f791-4a89-81a8-4c2c0349a970 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.540279 May 23 16:50:16.686456 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 221/448] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:16 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:50:16.698102 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-790b24cc-67e4-4ae8-bcfa-00aa8e06763f tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:16.706969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-790b24cc-67e4-4ae8-bcfa-00aa8e06763f tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1700 microversion: 2.1 time: 0.425385 May 23 16:50:16.707547 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 228/449] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:16 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1700 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:50:16.731376 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-3975dd5d-a596-4471-a610-a96e819452bb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:50:16.737416 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3975dd5d-a596-4471-a610-a96e819452bb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:16.737894 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3975dd5d-a596-4471-a610-a96e819452bb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:16.801713 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-3975dd5d-a596-4471-a610-a96e819452bb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Going to try to start instance {{(pid=124714) start /opt/stack/nova/nova/compute/api.py:2730}} May 23 16:50:17.042308 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-3975dd5d-a596-4471-a610-a96e819452bb tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "POST /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4/action" status: 202 len: 0 microversion: 2.1 time: 0.314547 May 23 16:50:17.042921 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 222/450] 10.222.0.74 () {60 vars in 1277 bytes} [Mon May 23 16:50:16 2022] POST /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:50:17.058997 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-ed6743ab-50b8-4280-92e4-8f094f6bfcbf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:17.059625 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-ed6743ab-50b8-4280-92e4-8f094f6bfcbf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:17.066421 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ed6743ab-50b8-4280-92e4-8f094f6bfcbf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:17.066944 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ed6743ab-50b8-4280-92e4-8f094f6bfcbf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:17.067710 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ed6743ab-50b8-4280-92e4-8f094f6bfcbf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:17.068157 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ed6743ab-50b8-4280-92e4-8f094f6bfcbf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:17.206633 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-ed6743ab-50b8-4280-92e4-8f094f6bfcbf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:17.223323 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-ed6743ab-50b8-4280-92e4-8f094f6bfcbf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1709 microversion: 2.1 time: 0.168551 May 23 16:50:17.224190 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 229/451] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:17 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1709 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:17.707924 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-e1c5aac8-4769-4dfd-af06-ee9fa3860439 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:17.707924 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-e1c5aac8-4769-4dfd-af06-ee9fa3860439 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:17.712383 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e1c5aac8-4769-4dfd-af06-ee9fa3860439 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:17.712895 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e1c5aac8-4769-4dfd-af06-ee9fa3860439 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:17.713741 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e1c5aac8-4769-4dfd-af06-ee9fa3860439 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:17.714332 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e1c5aac8-4769-4dfd-af06-ee9fa3860439 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:17.865057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e1c5aac8-4769-4dfd-af06-ee9fa3860439 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:17.875037 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e1c5aac8-4769-4dfd-af06-ee9fa3860439 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:17.876907 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e1c5aac8-4769-4dfd-af06-ee9fa3860439 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:17.878154 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-e1c5aac8-4769-4dfd-af06-ee9fa3860439 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.178746 May 23 16:50:17.878717 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 223/452] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:17 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:18.241392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c2024c78-77cf-4097-a24b-8d4b840662bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:18.242022 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-c2024c78-77cf-4097-a24b-8d4b840662bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:18.248770 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c2024c78-77cf-4097-a24b-8d4b840662bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:18.249229 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c2024c78-77cf-4097-a24b-8d4b840662bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:18.250008 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c2024c78-77cf-4097-a24b-8d4b840662bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:18.250450 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c2024c78-77cf-4097-a24b-8d4b840662bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:18.386827 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-c2024c78-77cf-4097-a24b-8d4b840662bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:18.395328 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-c2024c78-77cf-4097-a24b-8d4b840662bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1709 microversion: 2.1 time: 0.157821 May 23 16:50:18.395909 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 230/453] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:18 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1709 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:18.848059 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-2de7463f-da98-4415-8281-041d7ddf4d10 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a7175af-a87b-4f6b-9e72-c87940ef51a9"}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:50:18.849217 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-2de7463f-da98-4415-8281-041d7ddf4d10 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:18.855890 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2de7463f-da98-4415-8281-041d7ddf4d10 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:18.856366 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2de7463f-da98-4415-8281-041d7ddf4d10 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:18.857143 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2de7463f-da98-4415-8281-041d7ddf4d10 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:18.857587 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2de7463f-da98-4415-8281-041d7ddf4d10 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:18.897027 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-31eebf20-55d4-4d24-b290-8aa27c284ad5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:18.897661 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-31eebf20-55d4-4d24-b290-8aa27c284ad5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:18.904133 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-31eebf20-55d4-4d24-b290-8aa27c284ad5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:18.904634 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-31eebf20-55d4-4d24-b290-8aa27c284ad5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:18.905413 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-31eebf20-55d4-4d24-b290-8aa27c284ad5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:18.906226 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-31eebf20-55d4-4d24-b290-8aa27c284ad5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:19.047055 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-31eebf20-55d4-4d24-b290-8aa27c284ad5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:19.056669 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-31eebf20-55d4-4d24-b290-8aa27c284ad5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:19.058195 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-31eebf20-55d4-4d24-b290-8aa27c284ad5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:19.059379 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-31eebf20-55d4-4d24-b290-8aa27c284ad5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.166443 May 23 16:50:19.060125 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 231/454] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:18 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:50:19.413514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-dbff6302-517e-4eab-90d1-1e16cc0c27d2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:19.414239 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-dbff6302-517e-4eab-90d1-1e16cc0c27d2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:19.420727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dbff6302-517e-4eab-90d1-1e16cc0c27d2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:19.421184 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dbff6302-517e-4eab-90d1-1e16cc0c27d2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:19.421964 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dbff6302-517e-4eab-90d1-1e16cc0c27d2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:19.422407 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dbff6302-517e-4eab-90d1-1e16cc0c27d2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:19.558758 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-dbff6302-517e-4eab-90d1-1e16cc0c27d2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:19.566889 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-dbff6302-517e-4eab-90d1-1e16cc0c27d2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1709 microversion: 2.1 time: 0.157250 May 23 16:50:19.576272 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 232/455] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:19 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1709 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:50:20.078297 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-d8178027-f21a-4a5f-9807-1d088fd37f0a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:20.079567 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-d8178027-f21a-4a5f-9807-1d088fd37f0a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:20.086864 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d8178027-f21a-4a5f-9807-1d088fd37f0a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:20.087315 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d8178027-f21a-4a5f-9807-1d088fd37f0a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:20.088092 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d8178027-f21a-4a5f-9807-1d088fd37f0a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:20.088564 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d8178027-f21a-4a5f-9807-1d088fd37f0a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:20.234046 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d8178027-f21a-4a5f-9807-1d088fd37f0a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:20.242931 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d8178027-f21a-4a5f-9807-1d088fd37f0a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:20.244479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d8178027-f21a-4a5f-9807-1d088fd37f0a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:20.245658 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-d8178027-f21a-4a5f-9807-1d088fd37f0a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.171292 May 23 16:50:20.246227 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 233/456] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:20 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:50:20.583132 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-bbf7d769-740e-4acd-82b2-2ea2fd3e0193 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:20.584089 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-bbf7d769-740e-4acd-82b2-2ea2fd3e0193 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:20.591057 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bbf7d769-740e-4acd-82b2-2ea2fd3e0193 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:20.591518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bbf7d769-740e-4acd-82b2-2ea2fd3e0193 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:20.592364 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bbf7d769-740e-4acd-82b2-2ea2fd3e0193 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:20.592808 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bbf7d769-740e-4acd-82b2-2ea2fd3e0193 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:20.730483 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-bbf7d769-740e-4acd-82b2-2ea2fd3e0193 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:20.736148 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-bbf7d769-740e-4acd-82b2-2ea2fd3e0193 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1709 microversion: 2.1 time: 0.156886 May 23 16:50:20.737055 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 234/457] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:20 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1709 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:50:21.264578 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-3fe72d8c-e782-46f2-b96b-2dafd5f64db7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:21.265183 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-3fe72d8c-e782-46f2-b96b-2dafd5f64db7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:21.272058 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3fe72d8c-e782-46f2-b96b-2dafd5f64db7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:21.272562 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3fe72d8c-e782-46f2-b96b-2dafd5f64db7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:21.273341 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3fe72d8c-e782-46f2-b96b-2dafd5f64db7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:21.273779 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3fe72d8c-e782-46f2-b96b-2dafd5f64db7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:21.415007 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-3fe72d8c-e782-46f2-b96b-2dafd5f64db7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:21.424147 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-3fe72d8c-e782-46f2-b96b-2dafd5f64db7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:21.425719 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-3fe72d8c-e782-46f2-b96b-2dafd5f64db7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:21.426919 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-3fe72d8c-e782-46f2-b96b-2dafd5f64db7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.166323 May 23 16:50:21.427469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 235/458] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:21 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:50:21.758348 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-5e52c6fe-dccc-4fc9-9311-32239fdbbaa2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:21.759193 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-5e52c6fe-dccc-4fc9-9311-32239fdbbaa2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:21.765560 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5e52c6fe-dccc-4fc9-9311-32239fdbbaa2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:21.768409 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5e52c6fe-dccc-4fc9-9311-32239fdbbaa2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:21.768409 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5e52c6fe-dccc-4fc9-9311-32239fdbbaa2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:21.768409 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5e52c6fe-dccc-4fc9-9311-32239fdbbaa2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:21.901899 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-5e52c6fe-dccc-4fc9-9311-32239fdbbaa2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:21.910138 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-5e52c6fe-dccc-4fc9-9311-32239fdbbaa2 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1709 microversion: 2.1 time: 0.160404 May 23 16:50:21.910893 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 236/459] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:21 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1709 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:50:22.445115 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-6cb39181-29a5-4ce1-b6e8-61d2a523dcce tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:22.445752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-6cb39181-29a5-4ce1-b6e8-61d2a523dcce tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:22.452493 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6cb39181-29a5-4ce1-b6e8-61d2a523dcce tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:22.452968 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6cb39181-29a5-4ce1-b6e8-61d2a523dcce tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:22.453743 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6cb39181-29a5-4ce1-b6e8-61d2a523dcce tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:22.454182 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6cb39181-29a5-4ce1-b6e8-61d2a523dcce tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:22.588262 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-6cb39181-29a5-4ce1-b6e8-61d2a523dcce tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:22.598485 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-6cb39181-29a5-4ce1-b6e8-61d2a523dcce tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:22.600000 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-6cb39181-29a5-4ce1-b6e8-61d2a523dcce tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:22.601195 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-6cb39181-29a5-4ce1-b6e8-61d2a523dcce tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.160080 May 23 16:50:22.601962 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 237/460] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:22 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:50:22.927516 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7ba8c5cf-f0bc-412c-b34e-d504eb7653bd tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:22.928270 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-7ba8c5cf-f0bc-412c-b34e-d504eb7653bd tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:22.936487 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7ba8c5cf-f0bc-412c-b34e-d504eb7653bd tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:22.936928 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7ba8c5cf-f0bc-412c-b34e-d504eb7653bd tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:22.937709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7ba8c5cf-f0bc-412c-b34e-d504eb7653bd tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:22.938149 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7ba8c5cf-f0bc-412c-b34e-d504eb7653bd tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:23.076010 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-7ba8c5cf-f0bc-412c-b34e-d504eb7653bd tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:23.086951 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-7ba8c5cf-f0bc-412c-b34e-d504eb7653bd tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1709 microversion: 2.1 time: 0.163758 May 23 16:50:23.087543 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 238/461] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:22 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1709 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:50:23.620699 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-f607846f-5958-4089-ad48-5d3c37bb5d31 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:23.621331 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-f607846f-5958-4089-ad48-5d3c37bb5d31 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:23.628277 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f607846f-5958-4089-ad48-5d3c37bb5d31 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:23.629756 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f607846f-5958-4089-ad48-5d3c37bb5d31 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:23.630673 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f607846f-5958-4089-ad48-5d3c37bb5d31 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:23.631193 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f607846f-5958-4089-ad48-5d3c37bb5d31 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:23.768776 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f607846f-5958-4089-ad48-5d3c37bb5d31 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:23.777293 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f607846f-5958-4089-ad48-5d3c37bb5d31 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:23.778803 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f607846f-5958-4089-ad48-5d3c37bb5d31 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:23.780007 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-f607846f-5958-4089-ad48-5d3c37bb5d31 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.164548 May 23 16:50:23.780597 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 239/462] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:23 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:50:24.104120 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-ad276a27-50b0-454f-b7bd-474c38895aa4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:24.104844 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-ad276a27-50b0-454f-b7bd-474c38895aa4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:24.112205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ad276a27-50b0-454f-b7bd-474c38895aa4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:24.112683 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ad276a27-50b0-454f-b7bd-474c38895aa4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:24.113466 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ad276a27-50b0-454f-b7bd-474c38895aa4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:24.113911 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ad276a27-50b0-454f-b7bd-474c38895aa4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:24.255057 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-ad276a27-50b0-454f-b7bd-474c38895aa4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:24.263309 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-ad276a27-50b0-454f-b7bd-474c38895aa4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1709 microversion: 2.1 time: 0.162980 May 23 16:50:24.264094 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 240/463] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:24 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1709 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:50:24.799404 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c0aa833c-a019-4fb8-a6e0-884afbb76c6a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:24.800013 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-c0aa833c-a019-4fb8-a6e0-884afbb76c6a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:24.806194 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c0aa833c-a019-4fb8-a6e0-884afbb76c6a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:24.806651 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c0aa833c-a019-4fb8-a6e0-884afbb76c6a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:24.807426 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c0aa833c-a019-4fb8-a6e0-884afbb76c6a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:24.807871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c0aa833c-a019-4fb8-a6e0-884afbb76c6a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:24.942512 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-c0aa833c-a019-4fb8-a6e0-884afbb76c6a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:24.951397 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-c0aa833c-a019-4fb8-a6e0-884afbb76c6a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:24.953011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-c0aa833c-a019-4fb8-a6e0-884afbb76c6a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:24.954173 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-c0aa833c-a019-4fb8-a6e0-884afbb76c6a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.159253 May 23 16:50:24.955344 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 241/464] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:24 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:50:25.281261 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e736a74f-4dd5-40f4-bd1a-045054278f75 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:25.281975 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e736a74f-4dd5-40f4-bd1a-045054278f75 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:25.288959 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e736a74f-4dd5-40f4-bd1a-045054278f75 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:25.289443 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e736a74f-4dd5-40f4-bd1a-045054278f75 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:25.290234 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e736a74f-4dd5-40f4-bd1a-045054278f75 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:25.290678 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e736a74f-4dd5-40f4-bd1a-045054278f75 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:25.295127 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=100 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:50:25.428179 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e736a74f-4dd5-40f4-bd1a-045054278f75 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:25.436503 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e736a74f-4dd5-40f4-bd1a-045054278f75 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1709 microversion: 2.1 time: 0.159191 May 23 16:50:25.437297 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 242/465] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:25 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:50:25.975442 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-60a0dc09-92c7-46f1-9755-f6271b2d4a5c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:25.976150 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-60a0dc09-92c7-46f1-9755-f6271b2d4a5c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:25.982396 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-60a0dc09-92c7-46f1-9755-f6271b2d4a5c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:25.982852 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-60a0dc09-92c7-46f1-9755-f6271b2d4a5c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:25.983629 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-60a0dc09-92c7-46f1-9755-f6271b2d4a5c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:25.984073 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-60a0dc09-92c7-46f1-9755-f6271b2d4a5c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:26.122321 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-60a0dc09-92c7-46f1-9755-f6271b2d4a5c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:26.131662 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-60a0dc09-92c7-46f1-9755-f6271b2d4a5c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:26.133247 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-60a0dc09-92c7-46f1-9755-f6271b2d4a5c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:26.134438 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-60a0dc09-92c7-46f1-9755-f6271b2d4a5c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.163319 May 23 16:50:26.135005 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 243/466] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:25 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:50:26.455149 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-5beaea10-55f3-4c2d-a767-220f9ee7f634 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:26.455795 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-5beaea10-55f3-4c2d-a767-220f9ee7f634 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:26.462790 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5beaea10-55f3-4c2d-a767-220f9ee7f634 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:26.463252 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5beaea10-55f3-4c2d-a767-220f9ee7f634 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:26.464035 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5beaea10-55f3-4c2d-a767-220f9ee7f634 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:26.464511 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5beaea10-55f3-4c2d-a767-220f9ee7f634 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:26.608458 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-5beaea10-55f3-4c2d-a767-220f9ee7f634 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:26.620613 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-5beaea10-55f3-4c2d-a767-220f9ee7f634 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1709 microversion: 2.1 time: 0.169937 May 23 16:50:26.621323 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 244/467] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:26 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1709 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:50:27.152818 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-df8c20c8-62e9-4fa0-98a7-a86fc7bd7766 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:27.153438 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-df8c20c8-62e9-4fa0-98a7-a86fc7bd7766 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:27.160619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-df8c20c8-62e9-4fa0-98a7-a86fc7bd7766 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:27.161077 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-df8c20c8-62e9-4fa0-98a7-a86fc7bd7766 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:27.161853 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-df8c20c8-62e9-4fa0-98a7-a86fc7bd7766 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:27.162294 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-df8c20c8-62e9-4fa0-98a7-a86fc7bd7766 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:27.315479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-df8c20c8-62e9-4fa0-98a7-a86fc7bd7766 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:27.324694 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-df8c20c8-62e9-4fa0-98a7-a86fc7bd7766 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:27.326304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-df8c20c8-62e9-4fa0-98a7-a86fc7bd7766 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:27.327489 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-df8c20c8-62e9-4fa0-98a7-a86fc7bd7766 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.178657 May 23 16:50:27.328086 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 245/468] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:27 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:50:27.638896 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e09bde58-0745-454a-9bf5-fe922a9be27d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:27.639615 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e09bde58-0745-454a-9bf5-fe922a9be27d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:27.646752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e09bde58-0745-454a-9bf5-fe922a9be27d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:27.647208 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e09bde58-0745-454a-9bf5-fe922a9be27d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:27.647987 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e09bde58-0745-454a-9bf5-fe922a9be27d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:27.648471 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e09bde58-0745-454a-9bf5-fe922a9be27d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:27.789668 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e09bde58-0745-454a-9bf5-fe922a9be27d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:27.798684 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e09bde58-0745-454a-9bf5-fe922a9be27d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1709 microversion: 2.1 time: 0.163032 May 23 16:50:27.799519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 246/469] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:27 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1709 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:50:28.348027 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e971315c-cd64-4a39-8080-2c1313a27ebc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:28.348637 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e971315c-cd64-4a39-8080-2c1313a27ebc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:28.354688 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e971315c-cd64-4a39-8080-2c1313a27ebc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:28.355145 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e971315c-cd64-4a39-8080-2c1313a27ebc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:28.355919 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e971315c-cd64-4a39-8080-2c1313a27ebc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:28.356387 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e971315c-cd64-4a39-8080-2c1313a27ebc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:28.486881 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e971315c-cd64-4a39-8080-2c1313a27ebc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:28.495435 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e971315c-cd64-4a39-8080-2c1313a27ebc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:28.496976 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e971315c-cd64-4a39-8080-2c1313a27ebc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:28.498134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e971315c-cd64-4a39-8080-2c1313a27ebc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.155072 May 23 16:50:28.498692 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 247/470] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:28 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:50:28.815952 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-1d157347-3e74-4001-ac9a-855cb9b6e8b5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:28.816630 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-1d157347-3e74-4001-ac9a-855cb9b6e8b5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:28.823163 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1d157347-3e74-4001-ac9a-855cb9b6e8b5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:28.823617 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1d157347-3e74-4001-ac9a-855cb9b6e8b5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:28.824423 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1d157347-3e74-4001-ac9a-855cb9b6e8b5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:28.824866 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1d157347-3e74-4001-ac9a-855cb9b6e8b5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:28.855275 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=27 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:50:28.939910 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:50:28.955327 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-1d157347-3e74-4001-ac9a-855cb9b6e8b5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:28.963416 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-1d157347-3e74-4001-ac9a-855cb9b6e8b5 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1709 microversion: 2.1 time: 0.151374 May 23 16:50:28.964021 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 248/471] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:28 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1709 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:50:29.516576 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-35310c1b-acbc-4fbd-9e35-6d3db0dea943 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:29.517217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-35310c1b-acbc-4fbd-9e35-6d3db0dea943 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:29.523442 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-35310c1b-acbc-4fbd-9e35-6d3db0dea943 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:29.523888 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-35310c1b-acbc-4fbd-9e35-6d3db0dea943 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:29.524683 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-35310c1b-acbc-4fbd-9e35-6d3db0dea943 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:29.525114 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-35310c1b-acbc-4fbd-9e35-6d3db0dea943 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:29.700880 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-35310c1b-acbc-4fbd-9e35-6d3db0dea943 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:29.710397 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-35310c1b-acbc-4fbd-9e35-6d3db0dea943 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:29.711907 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-35310c1b-acbc-4fbd-9e35-6d3db0dea943 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:29.713130 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-35310c1b-acbc-4fbd-9e35-6d3db0dea943 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.200637 May 23 16:50:29.713690 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 249/472] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:29 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:50:29.980547 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-4fdc7ede-349f-48a3-9eee-96c8375ee42e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:29.981176 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-4fdc7ede-349f-48a3-9eee-96c8375ee42e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:29.988361 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4fdc7ede-349f-48a3-9eee-96c8375ee42e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:29.988817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4fdc7ede-349f-48a3-9eee-96c8375ee42e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:29.989583 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4fdc7ede-349f-48a3-9eee-96c8375ee42e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:29.990021 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4fdc7ede-349f-48a3-9eee-96c8375ee42e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:30.121898 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-4fdc7ede-349f-48a3-9eee-96c8375ee42e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:30.129873 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-4fdc7ede-349f-48a3-9eee-96c8375ee42e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1709 microversion: 2.1 time: 0.153291 May 23 16:50:30.130433 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 250/473] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:29 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1709 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:50:30.732219 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-224a5880-e4e1-4390-92c7-b08ac9b00591 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:30.732874 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-224a5880-e4e1-4390-92c7-b08ac9b00591 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:30.739941 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-224a5880-e4e1-4390-92c7-b08ac9b00591 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:30.740347 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-224a5880-e4e1-4390-92c7-b08ac9b00591 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:30.741133 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-224a5880-e4e1-4390-92c7-b08ac9b00591 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:30.741579 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-224a5880-e4e1-4390-92c7-b08ac9b00591 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:30.880629 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-224a5880-e4e1-4390-92c7-b08ac9b00591 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:30.890487 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-224a5880-e4e1-4390-92c7-b08ac9b00591 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:30.892004 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-224a5880-e4e1-4390-92c7-b08ac9b00591 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:30.893320 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-224a5880-e4e1-4390-92c7-b08ac9b00591 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.165195 May 23 16:50:30.898039 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 251/474] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:30 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:50:31.146579 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c988988f-0f29-4246-be29-1d65097af408 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:31.147186 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-c988988f-0f29-4246-be29-1d65097af408 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:31.153631 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c988988f-0f29-4246-be29-1d65097af408 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:31.154081 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c988988f-0f29-4246-be29-1d65097af408 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:31.154841 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c988988f-0f29-4246-be29-1d65097af408 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:31.155281 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c988988f-0f29-4246-be29-1d65097af408 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:31.286453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-c988988f-0f29-4246-be29-1d65097af408 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:31.296335 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-c988988f-0f29-4246-be29-1d65097af408 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1709 microversion: 2.1 time: 0.153569 May 23 16:50:31.296906 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 252/475] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:31 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1709 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:50:31.528091 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-2de7463f-da98-4415-8281-041d7ddf4d10 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "POST /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.684014 May 23 16:50:31.528787 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 224/476] 10.222.0.74 () {60 vars in 1322 bytes} [Mon May 23 16:50:18 2022] POST /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3/os-volume_attachments => generated 194 bytes in 12686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:50:31.912223 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-262bcf00-7e96-47e6-bd0e-1c2e915acf7e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:31.912853 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-262bcf00-7e96-47e6-bd0e-1c2e915acf7e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:31.918911 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-262bcf00-7e96-47e6-bd0e-1c2e915acf7e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:31.919359 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-262bcf00-7e96-47e6-bd0e-1c2e915acf7e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:31.920124 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-262bcf00-7e96-47e6-bd0e-1c2e915acf7e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:31.920596 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-262bcf00-7e96-47e6-bd0e-1c2e915acf7e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:32.053270 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-262bcf00-7e96-47e6-bd0e-1c2e915acf7e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:32.061807 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-262bcf00-7e96-47e6-bd0e-1c2e915acf7e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:32.063322 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-262bcf00-7e96-47e6-bd0e-1c2e915acf7e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:32.065558 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-262bcf00-7e96-47e6-bd0e-1c2e915acf7e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.157977 May 23 16:50:32.066124 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 253/477] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:31 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:32.316005 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ee8703ea-a1c3-4416-8525-5f14deeeb1c4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:32.317117 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ee8703ea-a1c3-4416-8525-5f14deeeb1c4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:32.323524 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ee8703ea-a1c3-4416-8525-5f14deeeb1c4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:32.323976 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ee8703ea-a1c3-4416-8525-5f14deeeb1c4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:32.324774 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ee8703ea-a1c3-4416-8525-5f14deeeb1c4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:32.325213 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ee8703ea-a1c3-4416-8525-5f14deeeb1c4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:32.462062 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ee8703ea-a1c3-4416-8525-5f14deeeb1c4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:32.470100 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ee8703ea-a1c3-4416-8525-5f14deeeb1c4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1709 microversion: 2.1 time: 0.159551 May 23 16:50:32.470708 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 225/478] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:32 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1709 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:33.087078 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-fbd7cded-434c-4191-85c0-509504e18a86 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:33.087683 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-fbd7cded-434c-4191-85c0-509504e18a86 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:33.095759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fbd7cded-434c-4191-85c0-509504e18a86 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:33.097126 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fbd7cded-434c-4191-85c0-509504e18a86 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:33.097982 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fbd7cded-434c-4191-85c0-509504e18a86 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:33.098433 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fbd7cded-434c-4191-85c0-509504e18a86 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:33.234767 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-fbd7cded-434c-4191-85c0-509504e18a86 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:33.243505 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-fbd7cded-434c-4191-85c0-509504e18a86 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:33.245409 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-fbd7cded-434c-4191-85c0-509504e18a86 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:33.250718 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-fbd7cded-434c-4191-85c0-509504e18a86 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.165213 May 23 16:50:33.250718 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 254/479] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:33 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:33.487265 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-dddd4b88-8e90-4c68-9fe6-5c167f50ac9e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:33.487788 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-dddd4b88-8e90-4c68-9fe6-5c167f50ac9e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:33.494627 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dddd4b88-8e90-4c68-9fe6-5c167f50ac9e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:33.495040 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dddd4b88-8e90-4c68-9fe6-5c167f50ac9e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:33.495820 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dddd4b88-8e90-4c68-9fe6-5c167f50ac9e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:33.496268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dddd4b88-8e90-4c68-9fe6-5c167f50ac9e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:33.643708 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-dddd4b88-8e90-4c68-9fe6-5c167f50ac9e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:33.652792 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-dddd4b88-8e90-4c68-9fe6-5c167f50ac9e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1713 microversion: 2.1 time: 0.169712 May 23 16:50:33.653596 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 226/480] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:33 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1713 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:34.265088 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-fd813a9d-6d48-411f-b691-ca2be176e8f7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:34.265710 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-fd813a9d-6d48-411f-b691-ca2be176e8f7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:34.273021 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fd813a9d-6d48-411f-b691-ca2be176e8f7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:34.273483 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fd813a9d-6d48-411f-b691-ca2be176e8f7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:34.274267 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fd813a9d-6d48-411f-b691-ca2be176e8f7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:34.274709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fd813a9d-6d48-411f-b691-ca2be176e8f7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:34.491188 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-fd813a9d-6d48-411f-b691-ca2be176e8f7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:34.499929 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-fd813a9d-6d48-411f-b691-ca2be176e8f7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:34.501461 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-fd813a9d-6d48-411f-b691-ca2be176e8f7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:34.502613 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-fd813a9d-6d48-411f-b691-ca2be176e8f7 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.241542 May 23 16:50:34.503258 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 255/481] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:34 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:35.520850 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-97f5cbdd-a010-4d60-816d-95acbf7d4f14 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:35.521465 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-97f5cbdd-a010-4d60-816d-95acbf7d4f14 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:35.528227 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-97f5cbdd-a010-4d60-816d-95acbf7d4f14 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:35.528780 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-97f5cbdd-a010-4d60-816d-95acbf7d4f14 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:35.529557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-97f5cbdd-a010-4d60-816d-95acbf7d4f14 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:35.530000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-97f5cbdd-a010-4d60-816d-95acbf7d4f14 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:35.658349 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-97f5cbdd-a010-4d60-816d-95acbf7d4f14 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:35.667249 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-97f5cbdd-a010-4d60-816d-95acbf7d4f14 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:35.668780 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-97f5cbdd-a010-4d60-816d-95acbf7d4f14 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:35.669931 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-97f5cbdd-a010-4d60-816d-95acbf7d4f14 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.153481 May 23 16:50:35.670495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 227/482] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:35 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:36.688758 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-91442a24-1439-4285-bfd1-fb39ed8bf7a9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:36.689372 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-91442a24-1439-4285-bfd1-fb39ed8bf7a9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:36.696505 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-91442a24-1439-4285-bfd1-fb39ed8bf7a9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:36.696961 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-91442a24-1439-4285-bfd1-fb39ed8bf7a9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:36.697727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-91442a24-1439-4285-bfd1-fb39ed8bf7a9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:36.698168 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-91442a24-1439-4285-bfd1-fb39ed8bf7a9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:36.831809 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-91442a24-1439-4285-bfd1-fb39ed8bf7a9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:36.841184 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-91442a24-1439-4285-bfd1-fb39ed8bf7a9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:36.842692 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-91442a24-1439-4285-bfd1-fb39ed8bf7a9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:36.843885 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-91442a24-1439-4285-bfd1-fb39ed8bf7a9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.159001 May 23 16:50:36.844483 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 256/483] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:36 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:37.864140 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-b467d407-90b6-4461-90fc-e03f832a7a42 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:37.864860 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-b467d407-90b6-4461-90fc-e03f832a7a42 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:37.871437 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b467d407-90b6-4461-90fc-e03f832a7a42 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:37.871876 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b467d407-90b6-4461-90fc-e03f832a7a42 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:37.872666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b467d407-90b6-4461-90fc-e03f832a7a42 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:37.873098 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b467d407-90b6-4461-90fc-e03f832a7a42 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:38.003627 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b467d407-90b6-4461-90fc-e03f832a7a42 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:38.012101 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b467d407-90b6-4461-90fc-e03f832a7a42 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:38.013773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b467d407-90b6-4461-90fc-e03f832a7a42 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:38.014932 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-b467d407-90b6-4461-90fc-e03f832a7a42 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.155373 May 23 16:50:38.015486 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 228/484] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:37 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:39.032633 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-06305a6a-c871-4361-a733-76198bdec6d1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:39.033240 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-06305a6a-c871-4361-a733-76198bdec6d1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:39.036367 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=84 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:50:39.041200 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-06305a6a-c871-4361-a733-76198bdec6d1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:39.041650 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-06305a6a-c871-4361-a733-76198bdec6d1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:39.046583 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-06305a6a-c871-4361-a733-76198bdec6d1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:39.049140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-06305a6a-c871-4361-a733-76198bdec6d1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:39.182463 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-06305a6a-c871-4361-a733-76198bdec6d1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:39.190943 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-06305a6a-c871-4361-a733-76198bdec6d1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:39.192487 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-06305a6a-c871-4361-a733-76198bdec6d1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:39.193660 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-06305a6a-c871-4361-a733-76198bdec6d1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.165079 May 23 16:50:39.194227 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 257/485] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:39 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:40.211408 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-e53be075-8c9d-4d70-8506-fb8b32ecaa9d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:40.212652 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-e53be075-8c9d-4d70-8506-fb8b32ecaa9d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:40.219097 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e53be075-8c9d-4d70-8506-fb8b32ecaa9d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:40.219555 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e53be075-8c9d-4d70-8506-fb8b32ecaa9d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:40.220350 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e53be075-8c9d-4d70-8506-fb8b32ecaa9d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:40.220791 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e53be075-8c9d-4d70-8506-fb8b32ecaa9d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:40.360150 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e53be075-8c9d-4d70-8506-fb8b32ecaa9d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:40.369028 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e53be075-8c9d-4d70-8506-fb8b32ecaa9d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:40.370541 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e53be075-8c9d-4d70-8506-fb8b32ecaa9d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:40.371698 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-e53be075-8c9d-4d70-8506-fb8b32ecaa9d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.164492 May 23 16:50:40.372258 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 229/486] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:40 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:41.287830 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-bbae840e-c0d9-413b-a95b-782852cfd7ca tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:50:41.288882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-bbae840e-c0d9-413b-a95b-782852cfd7ca tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:41.295235 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bbae840e-c0d9-413b-a95b-782852cfd7ca tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:41.295693 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bbae840e-c0d9-413b-a95b-782852cfd7ca tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:41.296579 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bbae840e-c0d9-413b-a95b-782852cfd7ca tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:41.297021 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bbae840e-c0d9-413b-a95b-782852cfd7ca tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:41.320526 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.objects.instance [None req-bbae840e-c0d9-413b-a95b-782852cfd7ca tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lazy-loading 'flavor' on Instance uuid 14a3c1df-8e11-4485-a5ef-fa843b4362d3 {{(pid=124715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:50:41.323914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=100 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:50:41.390709 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-4050e92a-e327-48be-8be7-f2249c28f0ab tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:41.391357 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-4050e92a-e327-48be-8be7-f2249c28f0ab tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:41.398096 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4050e92a-e327-48be-8be7-f2249c28f0ab tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:41.398546 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4050e92a-e327-48be-8be7-f2249c28f0ab tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:41.399315 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4050e92a-e327-48be-8be7-f2249c28f0ab tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:41.399750 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4050e92a-e327-48be-8be7-f2249c28f0ab tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:41.529213 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-4050e92a-e327-48be-8be7-f2249c28f0ab tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:41.537899 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-4050e92a-e327-48be-8be7-f2249c28f0ab tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:41.539447 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-4050e92a-e327-48be-8be7-f2249c28f0ab tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:41.540714 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-4050e92a-e327-48be-8be7-f2249c28f0ab tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.153882 May 23 16:50:41.541283 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 230/487] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:41 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:50:41.615861 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-bbae840e-c0d9-413b-a95b-782852cfd7ca tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "POST /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3/action" status: 200 len: 32 microversion: 2.1 time: 0.331973 May 23 16:50:41.616679 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 258/488] 10.222.0.74 () {60 vars in 1277 bytes} [Mon May 23 16:50:41 2022] POST /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3/action => generated 32 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 16:50:41.625723 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-784c60a6-01b6-4d85-8153-1240e2326879 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:41.626343 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-784c60a6-01b6-4d85-8153-1240e2326879 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:41.633459 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-784c60a6-01b6-4d85-8153-1240e2326879 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:41.633919 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-784c60a6-01b6-4d85-8153-1240e2326879 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:41.634689 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-784c60a6-01b6-4d85-8153-1240e2326879 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:41.635126 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-784c60a6-01b6-4d85-8153-1240e2326879 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:41.797260 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-efac545e-d441-44f7-994d-389ebc1cfdb7 req-4e39bc0b-1127-4e04-9deb-14c10225d70c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb302c29-c30d-4ffa-af9d-1f226fd56357", "name": "network-vif-plugged", "status": "completed", "tag": "bd409a76-162e-44c7-9e54-76b5e47accda"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:50:41.806531 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-efac545e-d441-44f7-994d-389ebc1cfdb7 req-4e39bc0b-1127-4e04-9deb-14c10225d70c service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:41.807240 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-efac545e-d441-44f7-994d-389ebc1cfdb7 req-4e39bc0b-1127-4e04-9deb-14c10225d70c service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:41.819170 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-efac545e-d441-44f7-994d-389ebc1cfdb7 req-4e39bc0b-1127-4e04-9deb-14c10225d70c service nova] Creating event network-vif-plugged:bd409a76-162e-44c7-9e54-76b5e47accda for instance bb302c29-c30d-4ffa-af9d-1f226fd56357 on hv-cinder-83925 May 23 16:50:41.824038 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-efac545e-d441-44f7-994d-389ebc1cfdb7 req-4e39bc0b-1127-4e04-9deb-14c10225d70c service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031212 May 23 16:50:41.824721 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 259/489] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:50:41.855110 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-784c60a6-01b6-4d85-8153-1240e2326879 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:41.866806 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-784c60a6-01b6-4d85-8153-1240e2326879 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1735 microversion: 2.1 time: 0.244064 May 23 16:50:41.878934 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 231/490] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:41 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1735 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:42.560069 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-9f9e3d70-b5d5-4800-aa13-7b6c665f690c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:42.560812 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-9f9e3d70-b5d5-4800-aa13-7b6c665f690c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:42.567761 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9f9e3d70-b5d5-4800-aa13-7b6c665f690c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:42.568212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9f9e3d70-b5d5-4800-aa13-7b6c665f690c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:42.569008 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9f9e3d70-b5d5-4800-aa13-7b6c665f690c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:42.569441 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9f9e3d70-b5d5-4800-aa13-7b6c665f690c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:42.698179 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-9f9e3d70-b5d5-4800-aa13-7b6c665f690c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:42.706427 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-9f9e3d70-b5d5-4800-aa13-7b6c665f690c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:42.707910 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-9f9e3d70-b5d5-4800-aa13-7b6c665f690c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:42.709335 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-9f9e3d70-b5d5-4800-aa13-7b6c665f690c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.154078 May 23 16:50:42.709889 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 260/491] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:42 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:42.884127 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-6a0d1c40-bbc2-402e-980a-915afc94140f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:42.884774 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-6a0d1c40-bbc2-402e-980a-915afc94140f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:42.891269 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6a0d1c40-bbc2-402e-980a-915afc94140f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:42.891710 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6a0d1c40-bbc2-402e-980a-915afc94140f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:42.892631 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6a0d1c40-bbc2-402e-980a-915afc94140f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:42.893665 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6a0d1c40-bbc2-402e-980a-915afc94140f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:43.025915 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-6a0d1c40-bbc2-402e-980a-915afc94140f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:43.034421 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-6a0d1c40-bbc2-402e-980a-915afc94140f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1735 microversion: 2.1 time: 0.153524 May 23 16:50:43.034992 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 232/492] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:42 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:43.727795 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a9452b0c-5eba-4558-adab-964715bf994a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:43.728439 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a9452b0c-5eba-4558-adab-964715bf994a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:43.734927 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a9452b0c-5eba-4558-adab-964715bf994a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:43.735387 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a9452b0c-5eba-4558-adab-964715bf994a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:43.736165 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a9452b0c-5eba-4558-adab-964715bf994a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:43.736638 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a9452b0c-5eba-4558-adab-964715bf994a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:43.871760 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a9452b0c-5eba-4558-adab-964715bf994a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:43.880859 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a9452b0c-5eba-4558-adab-964715bf994a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:43.882365 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a9452b0c-5eba-4558-adab-964715bf994a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:43.883508 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a9452b0c-5eba-4558-adab-964715bf994a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.159659 May 23 16:50:43.884060 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 261/493] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:43 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:44.161087 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-99d17d06-b578-4f8a-aad5-9d17aab3a3eb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:44.161694 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-99d17d06-b578-4f8a-aad5-9d17aab3a3eb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:44.167567 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-99d17d06-b578-4f8a-aad5-9d17aab3a3eb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:44.168013 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-99d17d06-b578-4f8a-aad5-9d17aab3a3eb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:44.168798 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-99d17d06-b578-4f8a-aad5-9d17aab3a3eb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:44.169233 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-99d17d06-b578-4f8a-aad5-9d17aab3a3eb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:44.297464 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-99d17d06-b578-4f8a-aad5-9d17aab3a3eb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:44.306083 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-99d17d06-b578-4f8a-aad5-9d17aab3a3eb tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1735 microversion: 2.1 time: 0.258248 May 23 16:50:44.306606 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 233/494] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:44 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1735 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:44.902448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-9902652b-8bf1-466c-a35c-94f68c2137c5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:44.903062 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-9902652b-8bf1-466c-a35c-94f68c2137c5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:44.910259 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9902652b-8bf1-466c-a35c-94f68c2137c5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:44.910807 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9902652b-8bf1-466c-a35c-94f68c2137c5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:44.914390 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9902652b-8bf1-466c-a35c-94f68c2137c5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:44.914390 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9902652b-8bf1-466c-a35c-94f68c2137c5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:45.045656 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-9902652b-8bf1-466c-a35c-94f68c2137c5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:45.054812 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-9902652b-8bf1-466c-a35c-94f68c2137c5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:45.056335 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-9902652b-8bf1-466c-a35c-94f68c2137c5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:45.057525 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-9902652b-8bf1-466c-a35c-94f68c2137c5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1809 microversion: 2.20 time: 0.159260 May 23 16:50:45.058092 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 262/495] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:44 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:45.323971 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-d2983b56-b83f-4a04-be04-1b8d474e05ed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:45.324741 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-d2983b56-b83f-4a04-be04-1b8d474e05ed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:45.331304 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d2983b56-b83f-4a04-be04-1b8d474e05ed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:45.332266 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d2983b56-b83f-4a04-be04-1b8d474e05ed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:45.333244 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d2983b56-b83f-4a04-be04-1b8d474e05ed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:45.333984 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d2983b56-b83f-4a04-be04-1b8d474e05ed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:45.465282 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-d2983b56-b83f-4a04-be04-1b8d474e05ed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:45.473982 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-d2983b56-b83f-4a04-be04-1b8d474e05ed tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1735 microversion: 2.1 time: 0.153791 May 23 16:50:45.474569 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 234/496] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:45 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:46.075757 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-bba91a65-438d-4e2e-9ef7-1151c53ecff5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:46.076411 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-bba91a65-438d-4e2e-9ef7-1151c53ecff5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:46.083517 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bba91a65-438d-4e2e-9ef7-1151c53ecff5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:46.084222 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bba91a65-438d-4e2e-9ef7-1151c53ecff5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:46.085023 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bba91a65-438d-4e2e-9ef7-1151c53ecff5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:46.085476 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bba91a65-438d-4e2e-9ef7-1151c53ecff5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:46.219186 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-bba91a65-438d-4e2e-9ef7-1151c53ecff5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:46.228183 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-bba91a65-438d-4e2e-9ef7-1151c53ecff5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:46.229736 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-bba91a65-438d-4e2e-9ef7-1151c53ecff5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:46.230892 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-bba91a65-438d-4e2e-9ef7-1151c53ecff5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1796 microversion: 2.20 time: 0.159096 May 23 16:50:46.231453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 263/497] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:50:46 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1796 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:50:46.492113 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-e5292cb9-d4c1-499a-8e08-dfc557ae7091 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:46.492684 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-e5292cb9-d4c1-499a-8e08-dfc557ae7091 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:46.499229 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e5292cb9-d4c1-499a-8e08-dfc557ae7091 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:46.499684 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e5292cb9-d4c1-499a-8e08-dfc557ae7091 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:46.500527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e5292cb9-d4c1-499a-8e08-dfc557ae7091 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:46.500972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e5292cb9-d4c1-499a-8e08-dfc557ae7091 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:46.628789 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e5292cb9-d4c1-499a-8e08-dfc557ae7091 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:46.636755 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-e5292cb9-d4c1-499a-8e08-dfc557ae7091 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1735 microversion: 2.1 time: 0.149494 May 23 16:50:46.637322 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 235/498] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:46 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:47.654306 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-ce35f755-3ef0-4877-88b4-80d87bbff6f0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:47.654924 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-ce35f755-3ef0-4877-88b4-80d87bbff6f0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:47.662380 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ce35f755-3ef0-4877-88b4-80d87bbff6f0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:47.662834 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ce35f755-3ef0-4877-88b4-80d87bbff6f0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:47.663612 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ce35f755-3ef0-4877-88b4-80d87bbff6f0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:47.664054 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ce35f755-3ef0-4877-88b4-80d87bbff6f0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:47.803062 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-ce35f755-3ef0-4877-88b4-80d87bbff6f0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:47.811298 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-ce35f755-3ef0-4877-88b4-80d87bbff6f0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1735 microversion: 2.1 time: 0.160883 May 23 16:50:47.811869 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 264/499] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:47 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:48.829112 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-210c5203-328f-40c6-aecb-61361b3a1a34 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:48.829790 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-210c5203-328f-40c6-aecb-61361b3a1a34 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:48.836738 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-210c5203-328f-40c6-aecb-61361b3a1a34 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:48.837187 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-210c5203-328f-40c6-aecb-61361b3a1a34 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:48.837978 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-210c5203-328f-40c6-aecb-61361b3a1a34 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:48.838415 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-210c5203-328f-40c6-aecb-61361b3a1a34 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:48.968046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-210c5203-328f-40c6-aecb-61361b3a1a34 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:48.976132 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-210c5203-328f-40c6-aecb-61361b3a1a34 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1735 microversion: 2.1 time: 0.150997 May 23 16:50:48.976725 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 236/500] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:48 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:49.993435 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7b1a06f2-2901-451a-8101-49666b94b30e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:49.994062 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-7b1a06f2-2901-451a-8101-49666b94b30e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:50.000694 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7b1a06f2-2901-451a-8101-49666b94b30e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:50.001152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7b1a06f2-2901-451a-8101-49666b94b30e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:50.001920 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7b1a06f2-2901-451a-8101-49666b94b30e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:50.002363 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7b1a06f2-2901-451a-8101-49666b94b30e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:50.130935 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-7b1a06f2-2901-451a-8101-49666b94b30e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:50.138815 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-7b1a06f2-2901-451a-8101-49666b94b30e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1735 microversion: 2.1 time: 0.149285 May 23 16:50:50.139381 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 265/501] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:49 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:51.157236 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-9a45154e-f305-427e-987a-8cdc61d8265b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:51.157887 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-9a45154e-f305-427e-987a-8cdc61d8265b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:51.165115 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9a45154e-f305-427e-987a-8cdc61d8265b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:51.165574 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9a45154e-f305-427e-987a-8cdc61d8265b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:51.166345 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9a45154e-f305-427e-987a-8cdc61d8265b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:51.166786 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9a45154e-f305-427e-987a-8cdc61d8265b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:51.297989 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-9a45154e-f305-427e-987a-8cdc61d8265b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:51.306759 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-9a45154e-f305-427e-987a-8cdc61d8265b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1735 microversion: 2.1 time: 0.152689 May 23 16:50:51.306759 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 237/502] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:51 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:50:52.323398 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-fc5ca998-250f-45f1-b72c-f91472fb4e66 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:52.324009 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-fc5ca998-250f-45f1-b72c-f91472fb4e66 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:52.330495 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fc5ca998-250f-45f1-b72c-f91472fb4e66 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:52.337804 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fc5ca998-250f-45f1-b72c-f91472fb4e66 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:52.337804 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fc5ca998-250f-45f1-b72c-f91472fb4e66 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:52.337804 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fc5ca998-250f-45f1-b72c-f91472fb4e66 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:52.458589 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-fc5ca998-250f-45f1-b72c-f91472fb4e66 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:52.468964 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-fc5ca998-250f-45f1-b72c-f91472fb4e66 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1735 microversion: 2.1 time: 0.147161 May 23 16:50:52.468964 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 266/503] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:52 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:50:53.484500 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-f3ba0122-c974-43fa-9aa0-96919e86f5a1 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:53.485046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-f3ba0122-c974-43fa-9aa0-96919e86f5a1 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:53.492529 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f3ba0122-c974-43fa-9aa0-96919e86f5a1 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:53.492979 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f3ba0122-c974-43fa-9aa0-96919e86f5a1 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:53.493739 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f3ba0122-c974-43fa-9aa0-96919e86f5a1 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:53.494175 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f3ba0122-c974-43fa-9aa0-96919e86f5a1 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:53.621033 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-f3ba0122-c974-43fa-9aa0-96919e86f5a1 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:53.628968 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-f3ba0122-c974-43fa-9aa0-96919e86f5a1 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1735 microversion: 2.1 time: 0.148447 May 23 16:50:53.629540 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 238/504] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:53 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:54.645376 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-320ddbf5-a879-45ca-aeb1-1e250b0a4202 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:54.646002 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-320ddbf5-a879-45ca-aeb1-1e250b0a4202 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:54.653275 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-320ddbf5-a879-45ca-aeb1-1e250b0a4202 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:54.653723 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-320ddbf5-a879-45ca-aeb1-1e250b0a4202 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:54.654487 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-320ddbf5-a879-45ca-aeb1-1e250b0a4202 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:54.654925 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-320ddbf5-a879-45ca-aeb1-1e250b0a4202 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:54.788833 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-320ddbf5-a879-45ca-aeb1-1e250b0a4202 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:54.796774 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-320ddbf5-a879-45ca-aeb1-1e250b0a4202 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1735 microversion: 2.1 time: 0.155298 May 23 16:50:54.797363 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 267/505] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:54 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:55.815069 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-90c4efa5-7f2a-4598-af59-cf67181dcc69 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:55.815715 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-90c4efa5-7f2a-4598-af59-cf67181dcc69 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:55.823512 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-90c4efa5-7f2a-4598-af59-cf67181dcc69 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:55.823968 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-90c4efa5-7f2a-4598-af59-cf67181dcc69 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:55.824787 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-90c4efa5-7f2a-4598-af59-cf67181dcc69 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:55.825236 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-90c4efa5-7f2a-4598-af59-cf67181dcc69 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:55.966085 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-90c4efa5-7f2a-4598-af59-cf67181dcc69 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:55.974355 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-90c4efa5-7f2a-4598-af59-cf67181dcc69 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1735 microversion: 2.1 time: 0.163336 May 23 16:50:55.975013 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 239/506] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:55 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:56.992002 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-30cfcfe5-e786-42df-bb33-fdb575e8a60f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:56.992642 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-30cfcfe5-e786-42df-bb33-fdb575e8a60f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:56.999040 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30cfcfe5-e786-42df-bb33-fdb575e8a60f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:56.999486 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30cfcfe5-e786-42df-bb33-fdb575e8a60f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:57.000241 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30cfcfe5-e786-42df-bb33-fdb575e8a60f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:57.000718 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30cfcfe5-e786-42df-bb33-fdb575e8a60f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:57.128428 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-30cfcfe5-e786-42df-bb33-fdb575e8a60f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:57.136385 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-30cfcfe5-e786-42df-bb33-fdb575e8a60f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1735 microversion: 2.1 time: 0.148328 May 23 16:50:57.136954 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 268/507] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:56 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:58.153929 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-4c29beb3-7853-4c93-b577-a68b7decc75c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:58.154549 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-4c29beb3-7853-4c93-b577-a68b7decc75c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:58.161316 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4c29beb3-7853-4c93-b577-a68b7decc75c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:58.161766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4c29beb3-7853-4c93-b577-a68b7decc75c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:58.162568 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4c29beb3-7853-4c93-b577-a68b7decc75c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:58.163005 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4c29beb3-7853-4c93-b577-a68b7decc75c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:58.167709 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:50:58.292167 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-4c29beb3-7853-4c93-b577-a68b7decc75c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:58.300027 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-4c29beb3-7853-4c93-b577-a68b7decc75c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1735 microversion: 2.1 time: 0.150037 May 23 16:50:58.300615 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 240/508] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:58 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:50:59.317792 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c14cead0-db71-4cbd-9eaa-0d1f43929583 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:50:59.318411 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-c14cead0-db71-4cbd-9eaa-0d1f43929583 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:50:59.325517 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c14cead0-db71-4cbd-9eaa-0d1f43929583 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:59.325969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c14cead0-db71-4cbd-9eaa-0d1f43929583 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:59.326730 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c14cead0-db71-4cbd-9eaa-0d1f43929583 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:50:59.327169 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c14cead0-db71-4cbd-9eaa-0d1f43929583 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:50:59.457975 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-c14cead0-db71-4cbd-9eaa-0d1f43929583 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:50:59.466195 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-c14cead0-db71-4cbd-9eaa-0d1f43929583 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1735 microversion: 2.1 time: 0.152259 May 23 16:50:59.474688 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 269/509] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:50:59 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:00.482980 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-780a0ddd-c820-43f8-ac26-4a9a3dcae9fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:00.483530 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-780a0ddd-c820-43f8-ac26-4a9a3dcae9fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:00.486347 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=33 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:51:00.491297 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-780a0ddd-c820-43f8-ac26-4a9a3dcae9fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:00.496337 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-780a0ddd-c820-43f8-ac26-4a9a3dcae9fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:00.496337 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-780a0ddd-c820-43f8-ac26-4a9a3dcae9fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:00.496337 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-780a0ddd-c820-43f8-ac26-4a9a3dcae9fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:00.861026 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-780a0ddd-c820-43f8-ac26-4a9a3dcae9fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:00.869425 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-780a0ddd-c820-43f8-ac26-4a9a3dcae9fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1735 microversion: 2.1 time: 0.390409 May 23 16:51:00.870003 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 241/510] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:00 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1735 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:01.887164 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-4635ea65-00c7-41fa-aa75-9b7fbfb91253 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:01.887745 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-4635ea65-00c7-41fa-aa75-9b7fbfb91253 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:01.894365 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4635ea65-00c7-41fa-aa75-9b7fbfb91253 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:01.894814 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4635ea65-00c7-41fa-aa75-9b7fbfb91253 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:01.895567 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4635ea65-00c7-41fa-aa75-9b7fbfb91253 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:01.895998 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4635ea65-00c7-41fa-aa75-9b7fbfb91253 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:02.026328 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-4635ea65-00c7-41fa-aa75-9b7fbfb91253 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:02.034358 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-4635ea65-00c7-41fa-aa75-9b7fbfb91253 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1735 microversion: 2.1 time: 0.151558 May 23 16:51:02.034936 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 270/511] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:01 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:03.052442 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-d7a3a18c-2b60-4707-8a54-694979549b3f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:03.052989 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-d7a3a18c-2b60-4707-8a54-694979549b3f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:03.060129 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d7a3a18c-2b60-4707-8a54-694979549b3f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:03.062378 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d7a3a18c-2b60-4707-8a54-694979549b3f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:03.062378 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d7a3a18c-2b60-4707-8a54-694979549b3f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:03.062378 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d7a3a18c-2b60-4707-8a54-694979549b3f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:03.189325 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-d7a3a18c-2b60-4707-8a54-694979549b3f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:03.199162 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-d7a3a18c-2b60-4707-8a54-694979549b3f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1715 microversion: 2.1 time: 0.150542 May 23 16:51:03.199890 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 242/512] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:03 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1715 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:03.254263 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-70ec478a-4f91-48aa-9d03-8d3577879ba2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:03.254767 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-70ec478a-4f91-48aa-9d03-8d3577879ba2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:03.267130 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-70ec478a-4f91-48aa-9d03-8d3577879ba2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:03.267130 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-70ec478a-4f91-48aa-9d03-8d3577879ba2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:03.267130 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-70ec478a-4f91-48aa-9d03-8d3577879ba2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:03.267130 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-70ec478a-4f91-48aa-9d03-8d3577879ba2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:03.389635 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-70ec478a-4f91-48aa-9d03-8d3577879ba2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] HTTP exception thrown: Cannot 'detach_volume' instance 14a3c1df-8e11-4485-a5ef-fa843b4362d3 while it is in vm_state rescued May 23 16:51:03.391469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-70ec478a-4f91-48aa-9d03-8d3577879ba2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Request method failure captured: May 23 16:51:03.391469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: DELETE /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3/os-volume_attachments/7a7175af-a87b-4f6b-9e72-c87940ef51a9 HTTP/1.1 May 23 16:51:03.391469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:51:03.391469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:51:03.391469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:51:03.391469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:51:03.391469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:51:03.391469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:51:03.391469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:51:03.391469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:51:03.391469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7o2WukSo8MVh2vnrT0Gb8xsUoVX_gA4ZRtYP_ktCPbSO2DDauFM_C7u7kWk3VGOZRNEQJWCkkdSQViJZ1u-fzhESfTWj231c6MIBn8Mmt4wfYftDRBPMAgBmDWUt7URCKm3USy34i6WhHz3kcqn7lqeWxjid60wtGzqVjLxfEi2w6I May 23 16:51:03.391469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:51:03.391469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:51:03.391469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:51:03.391469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:51:03.391469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:51:03.391469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:51:03.391469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: 8c4eba5d39e545cbb8380490c86045f0 May 23 16:51:03.391469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-8767631 May 23 16:51:03.391469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:51:03.391469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:51:03.393155 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8c4eba5d39e545cbb8380490c86045f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8c4eba5d39e545cbb8380490c86045f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8c4eba5d39e545cbb8380490c86045f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8c4eba5d39e545cbb8380490c86045f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:51:03.393155 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-ServerRescueNegativeTestJSON-8767631 May 23 16:51:03.393155 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: 8c4eba5d39e545cbb8380490c86045f0 May 23 16:51:03.393155 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-8767631 May 23 16:51:03.393155 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-ServerRescueNegativeTestJSON-8767631-project May 23 16:51:03.393155 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:51:03.393155 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:51:03.393155 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: f14f77bc65fd4ff0bc1ec6de35846f14 May 23 16:51:03.393155 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-ServerRescueNegativeTestJSON-8767631-project May 23 16:51:03.393155 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 16:51:03.393155 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Cannot 'detach_volume' instance 14a3c1df-8e11-4485-a5ef-fa843b4362d3 while it is in vm_state rescued May 23 16:51:03.396768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'server_id': '14a3c1df-8e11-4485-a5ef-fa843b4362d3', 'id': '7a7175af-a87b-4f6b-9e72-c87940ef51a9'} May 23 16:51:03.396768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:51:03.396768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:51:03.396768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 16:51:03.396768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 16:51:03.396768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 16:51:03.396768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 16:51:03.396768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 23 16:51:03.396768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 23 16:51:03.396768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 14a3c1df-8e11-4485-a5ef-fa843b4362d3 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 23 16:51:03.396768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:51:03.396768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:51:03.396768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:51:03.396768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:51:03.396768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:51:03.396768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:51:03.396768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:51:03.396768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:51:03.396768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:51:03.396768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:51:03.398240 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 23 16:51:03.398240 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 23 16:51:03.398240 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 23 16:51:03.398240 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 23 16:51:03.398240 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 14a3c1df-8e11-4485-a5ef-fa843b4362d3 while it is in vm_state rescued May 23 16:51:03.398240 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:51:03.398240 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:51:03.398240 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:51:03.398240 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:51:03.398240 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:51:03.398240 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:51:03.398240 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:51:03.398240 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:51:03.398240 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 14a3c1df-8e11-4485-a5ef-fa843b4362d3 while it is in vm_state rescued May 23 16:51:03.398240 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:51:03.398240 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-70ec478a-4f91-48aa-9d03-8d3577879ba2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Returning 409 to user: Cannot 'detach_volume' instance 14a3c1df-8e11-4485-a5ef-fa843b4362d3 while it is in vm_state rescued {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:51:03.399485 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-70ec478a-4f91-48aa-9d03-8d3577879ba2 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "DELETE /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3/os-volume_attachments/7a7175af-a87b-4f6b-9e72-c87940ef51a9" status: 409 len: 152 microversion: 2.1 time: 0.142816 May 23 16:51:03.399485 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 271/513] 10.222.0.74 () {58 vars in 1415 bytes} [Mon May 23 16:51:03 2022] DELETE /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3/os-volume_attachments/7a7175af-a87b-4f6b-9e72-c87940ef51a9 => generated 152 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 23 16:51:03.401884 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-aacd9fea-5555-45a1-8278-2510c7b736f3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:51:03.402427 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-aacd9fea-5555-45a1-8278-2510c7b736f3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:03.408536 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-aacd9fea-5555-45a1-8278-2510c7b736f3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:03.408995 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-aacd9fea-5555-45a1-8278-2510c7b736f3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:03.409766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-aacd9fea-5555-45a1-8278-2510c7b736f3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:03.410213 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-aacd9fea-5555-45a1-8278-2510c7b736f3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:03.625958 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-aacd9fea-5555-45a1-8278-2510c7b736f3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "POST /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3/action" status: 202 len: 0 microversion: 2.1 time: 0.227742 May 23 16:51:03.626594 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 243/514] 10.222.0.74 () {60 vars in 1277 bytes} [Mon May 23 16:51:03 2022] POST /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:51:03.635055 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-be067abb-bf20-453a-9c13-21077c344420 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:03.635674 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-be067abb-bf20-453a-9c13-21077c344420 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:03.642376 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-be067abb-bf20-453a-9c13-21077c344420 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:03.645192 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-be067abb-bf20-453a-9c13-21077c344420 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:03.645192 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-be067abb-bf20-453a-9c13-21077c344420 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:03.645192 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-be067abb-bf20-453a-9c13-21077c344420 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:03.784539 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-be067abb-bf20-453a-9c13-21077c344420 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:03.793644 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-be067abb-bf20-453a-9c13-21077c344420 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1723 microversion: 2.1 time: 0.162717 May 23 16:51:03.794226 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 272/515] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:03 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:04.813067 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-b776c09b-b4ae-4c84-b9df-27645efd1999 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:04.813794 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-b776c09b-b4ae-4c84-b9df-27645efd1999 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:04.820112 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b776c09b-b4ae-4c84-b9df-27645efd1999 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:04.820607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b776c09b-b4ae-4c84-b9df-27645efd1999 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:04.821366 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b776c09b-b4ae-4c84-b9df-27645efd1999 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:04.821802 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b776c09b-b4ae-4c84-b9df-27645efd1999 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:04.948883 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b776c09b-b4ae-4c84-b9df-27645efd1999 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:04.956863 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-b776c09b-b4ae-4c84-b9df-27645efd1999 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1723 microversion: 2.1 time: 0.148758 May 23 16:51:04.957427 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 244/516] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:04 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:05.974683 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-704da56e-75c7-4d2e-8f1d-74c14be9f15c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:05.975212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-704da56e-75c7-4d2e-8f1d-74c14be9f15c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:05.981786 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-704da56e-75c7-4d2e-8f1d-74c14be9f15c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:05.982254 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-704da56e-75c7-4d2e-8f1d-74c14be9f15c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:05.983054 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-704da56e-75c7-4d2e-8f1d-74c14be9f15c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:05.983486 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-704da56e-75c7-4d2e-8f1d-74c14be9f15c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:06.111427 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-704da56e-75c7-4d2e-8f1d-74c14be9f15c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:06.119213 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-704da56e-75c7-4d2e-8f1d-74c14be9f15c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1723 microversion: 2.1 time: 0.148500 May 23 16:51:06.119778 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 273/517] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:05 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:07.137042 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-edbb1ffd-55b0-4d24-a206-ad8f8e80e4ff tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:07.137575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-edbb1ffd-55b0-4d24-a206-ad8f8e80e4ff tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:07.145114 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-edbb1ffd-55b0-4d24-a206-ad8f8e80e4ff tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:07.145572 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-edbb1ffd-55b0-4d24-a206-ad8f8e80e4ff tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:07.146341 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-edbb1ffd-55b0-4d24-a206-ad8f8e80e4ff tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:07.146811 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-edbb1ffd-55b0-4d24-a206-ad8f8e80e4ff tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:07.278905 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-edbb1ffd-55b0-4d24-a206-ad8f8e80e4ff tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:07.286911 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-edbb1ffd-55b0-4d24-a206-ad8f8e80e4ff tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1723 microversion: 2.1 time: 0.153830 May 23 16:51:07.287487 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 245/518] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:07 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:08.304274 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-29788117-557f-467c-9f25-6c0a254b6fa7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:08.305008 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-29788117-557f-467c-9f25-6c0a254b6fa7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:08.312341 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-29788117-557f-467c-9f25-6c0a254b6fa7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:08.312804 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-29788117-557f-467c-9f25-6c0a254b6fa7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:08.313594 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-29788117-557f-467c-9f25-6c0a254b6fa7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:08.314020 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-29788117-557f-467c-9f25-6c0a254b6fa7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:08.318181 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:51:08.442733 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-29788117-557f-467c-9f25-6c0a254b6fa7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:08.450557 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-29788117-557f-467c-9f25-6c0a254b6fa7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1729 microversion: 2.1 time: 0.150247 May 23 16:51:08.451128 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 274/519] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:08 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:08.467330 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-fa1c460c-39a4-45d9-a435-730787851e3c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:08.467814 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-fa1c460c-39a4-45d9-a435-730787851e3c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:08.474191 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fa1c460c-39a4-45d9-a435-730787851e3c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:08.474641 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fa1c460c-39a4-45d9-a435-730787851e3c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:08.475401 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fa1c460c-39a4-45d9-a435-730787851e3c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:08.475834 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fa1c460c-39a4-45d9-a435-730787851e3c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:08.556614 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-fa1c460c-39a4-45d9-a435-730787851e3c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093055 May 23 16:51:08.557216 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 246/520] 10.222.0.74 () {58 vars in 1274 bytes} [Mon May 23 16:51:08 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:51:09.531785 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-a08ab28c-d8bd-4c31-b3da-32e5199893e3 req-b8503a98-98da-4595-a3b4-9557426e93bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a3c1df-8e11-4485-a5ef-fa843b4362d3", "tag": "e00c55e6-6b89-4971-bceb-0a87e0ee6987"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:51:09.535634 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=36 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:51:09.540992 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-a08ab28c-d8bd-4c31-b3da-32e5199893e3 req-b8503a98-98da-4595-a3b4-9557426e93bd service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:09.541508 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-a08ab28c-d8bd-4c31-b3da-32e5199893e3 req-b8503a98-98da-4595-a3b4-9557426e93bd service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:09.552752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-a08ab28c-d8bd-4c31-b3da-32e5199893e3 req-b8503a98-98da-4595-a3b4-9557426e93bd service nova] Creating event network-changed:e00c55e6-6b89-4971-bceb-0a87e0ee6987 for instance 14a3c1df-8e11-4485-a5ef-fa843b4362d3 on hv-cinder-83925 May 23 16:51:09.558012 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-a08ab28c-d8bd-4c31-b3da-32e5199893e3 req-b8503a98-98da-4595-a3b4-9557426e93bd service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095920 May 23 16:51:09.558834 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 275/521] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:51:11.573773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-4d672418-2752-4b36-ab77-71cfc3d1d444 req-117204a5-0453-4254-a1a4-5933492b6251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a3c1df-8e11-4485-a5ef-fa843b4362d3", "tag": "e00c55e6-6b89-4971-bceb-0a87e0ee6987"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:51:11.582294 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-4d672418-2752-4b36-ab77-71cfc3d1d444 req-117204a5-0453-4254-a1a4-5933492b6251 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:11.582734 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-4d672418-2752-4b36-ab77-71cfc3d1d444 req-117204a5-0453-4254-a1a4-5933492b6251 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:11.594769 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-4d672418-2752-4b36-ab77-71cfc3d1d444 req-117204a5-0453-4254-a1a4-5933492b6251 service nova] Creating event network-changed:e00c55e6-6b89-4971-bceb-0a87e0ee6987 for instance 14a3c1df-8e11-4485-a5ef-fa843b4362d3 on hv-cinder-83925 May 23 16:51:11.599767 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-4d672418-2752-4b36-ab77-71cfc3d1d444 req-117204a5-0453-4254-a1a4-5933492b6251 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030199 May 23 16:51:11.600381 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 247/522] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:51:18.034671 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-abf9734d-8529-4517-bae7-d70874df365d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:51:18.035728 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-abf9734d-8529-4517-bae7-d70874df365d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:18.042864 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-abf9734d-8529-4517-bae7-d70874df365d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:18.043311 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-abf9734d-8529-4517-bae7-d70874df365d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:18.044067 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-abf9734d-8529-4517-bae7-d70874df365d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:18.044536 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-abf9734d-8529-4517-bae7-d70874df365d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:18.238829 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-abf9734d-8529-4517-bae7-d70874df365d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "POST /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089/action" status: 202 len: 0 microversion: 2.1 time: 0.209210 May 23 16:51:18.239669 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 276/523] 10.222.0.74 () {60 vars in 1277 bytes} [Mon May 23 16:51:18 2022] POST /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:51:18.249542 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-34bafacd-4e46-4b3c-803f-c205bc2cb87f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:18.250381 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-34bafacd-4e46-4b3c-803f-c205bc2cb87f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:18.256622 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-34bafacd-4e46-4b3c-803f-c205bc2cb87f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:18.257074 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-34bafacd-4e46-4b3c-803f-c205bc2cb87f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:18.257839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-34bafacd-4e46-4b3c-803f-c205bc2cb87f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:18.258298 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-34bafacd-4e46-4b3c-803f-c205bc2cb87f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:18.431152 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-34bafacd-4e46-4b3c-803f-c205bc2cb87f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:18.440074 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-34bafacd-4e46-4b3c-803f-c205bc2cb87f tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1752 microversion: 2.1 time: 0.195974 May 23 16:51:18.441852 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 248/524] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:18 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1752 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:19.460530 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-0bf6c916-ac45-483b-9672-d10cd07d75f2 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:19.461256 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-0bf6c916-ac45-483b-9672-d10cd07d75f2 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:19.467614 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0bf6c916-ac45-483b-9672-d10cd07d75f2 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:19.468001 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0bf6c916-ac45-483b-9672-d10cd07d75f2 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:19.468789 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0bf6c916-ac45-483b-9672-d10cd07d75f2 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:19.469221 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0bf6c916-ac45-483b-9672-d10cd07d75f2 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:19.610914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-0bf6c916-ac45-483b-9672-d10cd07d75f2 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:19.618952 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-0bf6c916-ac45-483b-9672-d10cd07d75f2 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1757 microversion: 2.1 time: 0.163406 May 23 16:51:19.619517 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 277/525] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:19 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:20.637819 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-8299c155-2bf3-4807-bc89-7d998644ab1b tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:20.638428 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-8299c155-2bf3-4807-bc89-7d998644ab1b tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:20.645017 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8299c155-2bf3-4807-bc89-7d998644ab1b tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:20.645458 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8299c155-2bf3-4807-bc89-7d998644ab1b tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:20.646210 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8299c155-2bf3-4807-bc89-7d998644ab1b tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:20.646641 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8299c155-2bf3-4807-bc89-7d998644ab1b tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:21.012511 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8299c155-2bf3-4807-bc89-7d998644ab1b tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:21.021688 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-8299c155-2bf3-4807-bc89-7d998644ab1b tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1757 microversion: 2.1 time: 0.387733 May 23 16:51:21.022261 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 249/526] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:20 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1757 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:22.041305 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e41e9a60-c6a8-4908-9ee9-59e838a4bd63 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:22.041967 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e41e9a60-c6a8-4908-9ee9-59e838a4bd63 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:22.048793 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e41e9a60-c6a8-4908-9ee9-59e838a4bd63 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:22.049247 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e41e9a60-c6a8-4908-9ee9-59e838a4bd63 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:22.050012 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e41e9a60-c6a8-4908-9ee9-59e838a4bd63 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:22.050454 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e41e9a60-c6a8-4908-9ee9-59e838a4bd63 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:22.189864 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e41e9a60-c6a8-4908-9ee9-59e838a4bd63 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:22.197821 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e41e9a60-c6a8-4908-9ee9-59e838a4bd63 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1757 microversion: 2.1 time: 0.160349 May 23 16:51:22.198381 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 278/527] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:22 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:51:23.218677 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-333e6600-53f1-496c-bea9-b32db43f3180 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:23.219303 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-333e6600-53f1-496c-bea9-b32db43f3180 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:23.225825 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-333e6600-53f1-496c-bea9-b32db43f3180 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:23.226278 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-333e6600-53f1-496c-bea9-b32db43f3180 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:23.227046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-333e6600-53f1-496c-bea9-b32db43f3180 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:23.227489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-333e6600-53f1-496c-bea9-b32db43f3180 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:23.370925 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-333e6600-53f1-496c-bea9-b32db43f3180 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:23.378914 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-333e6600-53f1-496c-bea9-b32db43f3180 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1757 microversion: 2.1 time: 0.165006 May 23 16:51:23.379480 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 250/528] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:23 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:24.396673 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7b3b3a3f-f274-4960-a77f-ed1c1da52142 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:24.397264 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-7b3b3a3f-f274-4960-a77f-ed1c1da52142 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:24.403696 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7b3b3a3f-f274-4960-a77f-ed1c1da52142 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:24.404726 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7b3b3a3f-f274-4960-a77f-ed1c1da52142 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:24.405580 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7b3b3a3f-f274-4960-a77f-ed1c1da52142 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:24.406020 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7b3b3a3f-f274-4960-a77f-ed1c1da52142 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:24.546744 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-7b3b3a3f-f274-4960-a77f-ed1c1da52142 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:24.554617 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-7b3b3a3f-f274-4960-a77f-ed1c1da52142 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1757 microversion: 2.1 time: 0.161747 May 23 16:51:24.555184 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 279/529] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:24 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:25.571839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ba13319d-e97c-4718-8a7b-71fad5866940 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:25.572494 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ba13319d-e97c-4718-8a7b-71fad5866940 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:25.581651 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ba13319d-e97c-4718-8a7b-71fad5866940 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:25.582130 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ba13319d-e97c-4718-8a7b-71fad5866940 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:25.582903 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ba13319d-e97c-4718-8a7b-71fad5866940 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:25.583349 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ba13319d-e97c-4718-8a7b-71fad5866940 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:25.728923 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ba13319d-e97c-4718-8a7b-71fad5866940 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:25.737518 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ba13319d-e97c-4718-8a7b-71fad5866940 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1757 microversion: 2.1 time: 0.169597 May 23 16:51:25.738108 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 251/530] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:25 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:26.393193 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-2edf18f9-0986-47c7-bfc6-9f347c14f91b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:26.393825 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-2edf18f9-0986-47c7-bfc6-9f347c14f91b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:26.400359 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2edf18f9-0986-47c7-bfc6-9f347c14f91b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:26.400822 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2edf18f9-0986-47c7-bfc6-9f347c14f91b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:26.401600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2edf18f9-0986-47c7-bfc6-9f347c14f91b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:26.402048 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2edf18f9-0986-47c7-bfc6-9f347c14f91b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:26.425309 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-2edf18f9-0986-47c7-bfc6-9f347c14f91b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef/ips" status: 200 len: 150 microversion: 2.1 time: 0.134359 May 23 16:51:26.425858 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 280/531] 10.222.0.74 () {58 vars in 1247 bytes} [Mon May 23 16:51:26 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef/ips => generated 150 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:51:26.437768 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-9636acd6-ded9-48dd-a2ae-b6aca5dd7551 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7417567b-3164-4149-8f79-7b61459536f3"}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:51:26.438923 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-9636acd6-ded9-48dd-a2ae-b6aca5dd7551 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:26.445018 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9636acd6-ded9-48dd-a2ae-b6aca5dd7551 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:26.445476 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9636acd6-ded9-48dd-a2ae-b6aca5dd7551 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:26.446243 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9636acd6-ded9-48dd-a2ae-b6aca5dd7551 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:26.446684 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9636acd6-ded9-48dd-a2ae-b6aca5dd7551 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:26.527974 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-9636acd6-ded9-48dd-a2ae-b6aca5dd7551 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] HTTP exception thrown: Invalid volume: volume 7417567b-3164-4149-8f79-7b61459536f3 is already attached to instances: ead45718-a5be-4d14-a83c-b6101b5ebc3c May 23 16:51:26.530598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-9636acd6-ded9-48dd-a2ae-b6aca5dd7551 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Request method failure captured: May 23 16:51:26.530598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: POST /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef/os-volume_attachments HTTP/1.1 May 23 16:51:26.530598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:51:26.530598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:51:26.530598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:51:26.530598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 74 May 23 16:51:26.530598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:51:26.530598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:51:26.530598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:51:26.530598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:51:26.530598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7oyo5VTSnwIFQPT0kTtFaHtIkHFj5L-FdhSIUmX9rttwLCW8jCAZ-X2qSMb7H2nHSgXjB6vWffoOpo-tnDcGctqzpOOjedHQxhH_K6_YUurOv1U6F0vB3iEbd4WjdXEZ7YlGpKqnMbRleSlAkItJeye3e1UHY4m4KuLnUpITA6zvao May 23 16:51:26.530598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:51:26.530598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:51:26.530598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:51:26.530598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:51:26.530598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:51:26.530598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:51:26.530598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:51:26.530598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:51:26.530598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:51:26.530598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:51:26.532092 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:51:26.532092 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:51:26.532092 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:51:26.532092 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:51:26.532092 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:51:26.532092 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:51:26.532092 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:51:26.532092 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 718a82d2f4294f68965ce01aac0fc166 May 23 16:51:26.532092 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:51:26.532092 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: May 23 16:51:26.532092 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {"volumeAttachment": {"volumeId": "7417567b-3164-4149-8f79-7b61459536f3"}} May 23 16:51:26.532092 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: > May 23 16:51:26.533094 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Invalid volume: volume 7417567b-3164-4149-8f79-7b61459536f3 is already attached to instances: ead45718-a5be-4d14-a83c-b6101b5ebc3c May 23 16:51:26.533094 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'server_id': 'd413ebb5-7e19-40ba-810b-505e89c582ef', 'body': {'volumeAttachment': {'volumeId': '7417567b-3164-4149-8f79-7b61459536f3'}}} May 23 16:51:26.533094 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:51:26.533094 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:51:26.533094 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 16:51:26.533094 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 16:51:26.533094 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 16:51:26.533094 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 16:51:26.533094 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 16:51:26.533094 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 16:51:26.533094 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 23 16:51:26.533094 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 23 16:51:26.533094 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 23 16:51:26.533094 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 23 16:51:26.533094 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7417567b-3164-4149-8f79-7b61459536f3 is already attached to instances: ead45718-a5be-4d14-a83c-b6101b5ebc3c May 23 16:51:26.533094 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:51:26.533094 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:51:26.533094 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:51:26.533094 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:51:26.534654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:51:26.534654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:51:26.534654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:51:26.534654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:51:26.534654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:51:26.534654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:51:26.534654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 16:51:26.534654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 16:51:26.534654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 16:51:26.534654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 16:51:26.534654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 16:51:26.534654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 16:51:26.534654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 23 16:51:26.534654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 16:51:26.534654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7417567b-3164-4149-8f79-7b61459536f3 is already attached to instances: ead45718-a5be-4d14-a83c-b6101b5ebc3c May 23 16:51:26.534654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:51:26.534654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:51:26.534654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:51:26.534654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:51:26.534654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:51:26.536490 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:51:26.536490 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:51:26.536490 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:51:26.536490 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7417567b-3164-4149-8f79-7b61459536f3 is already attached to instances: ead45718-a5be-4d14-a83c-b6101b5ebc3c May 23 16:51:26.536490 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:51:26.536490 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-9636acd6-ded9-48dd-a2ae-b6aca5dd7551 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Returning 400 to user: Invalid volume: volume 7417567b-3164-4149-8f79-7b61459536f3 is already attached to instances: ead45718-a5be-4d14-a83c-b6101b5ebc3c {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:51:26.536490 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-9636acd6-ded9-48dd-a2ae-b6aca5dd7551 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "POST /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098787 May 23 16:51:26.536490 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 252/532] 10.222.0.74 () {60 vars in 1322 bytes} [Mon May 23 16:51:26 2022] POST /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 16:51:26.541071 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a17eb868-05c3-4692-8845-d54bf8039c61 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:26.541566 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a17eb868-05c3-4692-8845-d54bf8039c61 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:26.547540 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a17eb868-05c3-4692-8845-d54bf8039c61 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:26.547992 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a17eb868-05c3-4692-8845-d54bf8039c61 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:26.548831 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a17eb868-05c3-4692-8845-d54bf8039c61 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:26.549271 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a17eb868-05c3-4692-8845-d54bf8039c61 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:26.572931 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a17eb868-05c3-4692-8845-d54bf8039c61 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Going to try to terminate instance {{(pid=124715) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 16:51:26.755283 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-649a94a2-3f08-4a4f-b2e6-59fab755f074 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:26.757334 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-649a94a2-3f08-4a4f-b2e6-59fab755f074 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:26.766555 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-649a94a2-3f08-4a4f-b2e6-59fab755f074 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:26.769355 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-649a94a2-3f08-4a4f-b2e6-59fab755f074 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:26.769355 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-649a94a2-3f08-4a4f-b2e6-59fab755f074 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:26.769355 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-649a94a2-3f08-4a4f-b2e6-59fab755f074 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:26.845809 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a17eb868-05c3-4692-8845-d54bf8039c61 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "DELETE /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 204 len: 0 microversion: 2.1 time: 0.308081 May 23 16:51:26.846278 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 281/533] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 16:51:26 2022] DELETE /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 16:51:26.854752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-8af7aa78-e945-498f-a29c-e9fb176ee127 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:26.855454 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-8af7aa78-e945-498f-a29c-e9fb176ee127 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:26.861531 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8af7aa78-e945-498f-a29c-e9fb176ee127 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:26.861984 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8af7aa78-e945-498f-a29c-e9fb176ee127 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:26.862753 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8af7aa78-e945-498f-a29c-e9fb176ee127 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:26.863190 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8af7aa78-e945-498f-a29c-e9fb176ee127 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:26.922555 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-649a94a2-3f08-4a4f-b2e6-59fab755f074 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:26.930693 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-649a94a2-3f08-4a4f-b2e6-59fab755f074 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1757 microversion: 2.1 time: 0.179320 May 23 16:51:26.931361 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 253/534] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:26 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:51:27.009544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-8af7aa78-e945-498f-a29c-e9fb176ee127 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:27.017163 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-8af7aa78-e945-498f-a29c-e9fb176ee127 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 200 len: 1681 microversion: 2.1 time: 0.166477 May 23 16:51:27.017731 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 282/535] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:26 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:51:27.948392 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-fb44aff5-0615-49e1-8b28-99664992bd77 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:27.949006 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-fb44aff5-0615-49e1-8b28-99664992bd77 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:27.955524 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fb44aff5-0615-49e1-8b28-99664992bd77 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:27.955970 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fb44aff5-0615-49e1-8b28-99664992bd77 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:27.956757 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fb44aff5-0615-49e1-8b28-99664992bd77 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:27.957225 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fb44aff5-0615-49e1-8b28-99664992bd77 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:28.034788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-b20e000d-4553-490e-8d2f-ac61bd875cea tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:28.035376 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-b20e000d-4553-490e-8d2f-ac61bd875cea tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:28.041968 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b20e000d-4553-490e-8d2f-ac61bd875cea tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:28.042420 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b20e000d-4553-490e-8d2f-ac61bd875cea tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:28.043191 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b20e000d-4553-490e-8d2f-ac61bd875cea tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:28.043633 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b20e000d-4553-490e-8d2f-ac61bd875cea tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:28.124251 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-fb44aff5-0615-49e1-8b28-99664992bd77 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:28.132178 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-fb44aff5-0615-49e1-8b28-99664992bd77 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1757 microversion: 2.1 time: 0.187604 May 23 16:51:28.132781 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 254/536] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:27 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:28.187109 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-b20e000d-4553-490e-8d2f-ac61bd875cea tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:28.194626 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-b20e000d-4553-490e-8d2f-ac61bd875cea tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 200 len: 1681 microversion: 2.1 time: 0.163754 May 23 16:51:28.195198 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 283/537] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:28 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:51:29.149366 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-266dc05e-54f6-44cd-a8ae-d1eb4664027a tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:29.149908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-266dc05e-54f6-44cd-a8ae-d1eb4664027a tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:29.156948 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-266dc05e-54f6-44cd-a8ae-d1eb4664027a tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:29.157394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-266dc05e-54f6-44cd-a8ae-d1eb4664027a tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:29.158152 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-266dc05e-54f6-44cd-a8ae-d1eb4664027a tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:29.158582 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-266dc05e-54f6-44cd-a8ae-d1eb4664027a tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:29.213759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-42c6aa42-0ca9-4aa9-ae2d-b0a29ebb9ba9 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:29.214377 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-42c6aa42-0ca9-4aa9-ae2d-b0a29ebb9ba9 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:29.221130 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-42c6aa42-0ca9-4aa9-ae2d-b0a29ebb9ba9 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:29.221576 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-42c6aa42-0ca9-4aa9-ae2d-b0a29ebb9ba9 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:29.222339 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-42c6aa42-0ca9-4aa9-ae2d-b0a29ebb9ba9 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:29.222772 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-42c6aa42-0ca9-4aa9-ae2d-b0a29ebb9ba9 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:29.480771 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-266dc05e-54f6-44cd-a8ae-d1eb4664027a tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:29.489240 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-266dc05e-54f6-44cd-a8ae-d1eb4664027a tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1757 microversion: 2.1 time: 0.343723 May 23 16:51:29.490050 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 255/538] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:29 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1757 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:29.521454 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-42c6aa42-0ca9-4aa9-ae2d-b0a29ebb9ba9 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:29.529163 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-42c6aa42-0ca9-4aa9-ae2d-b0a29ebb9ba9 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 200 len: 1681 microversion: 2.1 time: 0.320593 May 23 16:51:29.530561 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 284/539] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:29 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 1681 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:51:29.960644 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-c394a906-97c0-4fc3-aa3b-0379a7e9932c req-05f8010d-8c68-4375-aa77-66fc8f8c0958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d413ebb5-7e19-40ba-810b-505e89c582ef", "name": "network-vif-deleted", "tag": "f53be2ff-ed66-407e-961f-9ac93b76ebe4"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:51:29.969199 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-c394a906-97c0-4fc3-aa3b-0379a7e9932c req-05f8010d-8c68-4375-aa77-66fc8f8c0958 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:29.969650 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-c394a906-97c0-4fc3-aa3b-0379a7e9932c req-05f8010d-8c68-4375-aa77-66fc8f8c0958 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:29.980899 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-c394a906-97c0-4fc3-aa3b-0379a7e9932c req-05f8010d-8c68-4375-aa77-66fc8f8c0958 service nova] Creating event network-vif-deleted:f53be2ff-ed66-407e-961f-9ac93b76ebe4 for instance d413ebb5-7e19-40ba-810b-505e89c582ef on hv-cinder-83925 May 23 16:51:29.986363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-c394a906-97c0-4fc3-aa3b-0379a7e9932c req-05f8010d-8c68-4375-aa77-66fc8f8c0958 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029612 May 23 16:51:29.986896 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 256/540] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:51:30.507308 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e2e17d00-9989-4215-ac57-c5c7ad5d33b9 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:30.508247 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e2e17d00-9989-4215-ac57-c5c7ad5d33b9 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:30.516430 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e2e17d00-9989-4215-ac57-c5c7ad5d33b9 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:30.516932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e2e17d00-9989-4215-ac57-c5c7ad5d33b9 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:30.517781 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e2e17d00-9989-4215-ac57-c5c7ad5d33b9 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:30.518564 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e2e17d00-9989-4215-ac57-c5c7ad5d33b9 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:30.547802 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-8b0c283c-e261-49bb-832e-f14066ee05ab tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:30.548662 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-8b0c283c-e261-49bb-832e-f14066ee05ab tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:30.553367 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=32 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:51:30.557696 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8b0c283c-e261-49bb-832e-f14066ee05ab tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:30.558231 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8b0c283c-e261-49bb-832e-f14066ee05ab tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:30.559082 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8b0c283c-e261-49bb-832e-f14066ee05ab tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:30.559947 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8b0c283c-e261-49bb-832e-f14066ee05ab tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:30.566010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:51:30.648793 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8b0c283c-e261-49bb-832e-f14066ee05ab tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:30.659706 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-8b0c283c-e261-49bb-832e-f14066ee05ab tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 200 len: 1325 microversion: 2.1 time: 0.116333 May 23 16:51:30.670545 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 257/541] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:30 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 1325 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:51:30.727238 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e2e17d00-9989-4215-ac57-c5c7ad5d33b9 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:30.735530 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e2e17d00-9989-4215-ac57-c5c7ad5d33b9 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1760 microversion: 2.1 time: 0.232382 May 23 16:51:30.736102 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 285/542] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:30 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1760 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:31.677349 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-6d3f1469-07ab-4edb-82a4-d70c4e28f5a0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:31.678219 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-6d3f1469-07ab-4edb-82a4-d70c4e28f5a0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:31.685978 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6d3f1469-07ab-4edb-82a4-d70c4e28f5a0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:31.686693 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6d3f1469-07ab-4edb-82a4-d70c4e28f5a0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:31.687551 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6d3f1469-07ab-4edb-82a4-d70c4e28f5a0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:31.688147 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6d3f1469-07ab-4edb-82a4-d70c4e28f5a0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:31.723339 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6d3f1469-07ab-4edb-82a4-d70c4e28f5a0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:31.723789 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6d3f1469-07ab-4edb-82a4-d70c4e28f5a0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:31.724271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.objects.instance [None req-6d3f1469-07ab-4edb-82a4-d70c4e28f5a0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lazy-loading 'fault' on Instance uuid d413ebb5-7e19-40ba-810b-505e89c582ef {{(pid=124714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:51:31.768598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-6d3f1469-07ab-4edb-82a4-d70c4e28f5a0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:31.776666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-6d3f1469-07ab-4edb-82a4-d70c4e28f5a0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 200 len: 1330 microversion: 2.1 time: 0.103350 May 23 16:51:31.777244 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 258/543] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:31 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:32.795413 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e3a84e14-bea4-42f5-9d0d-9c2100076b04 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:32.795944 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e3a84e14-bea4-42f5-9d0d-9c2100076b04 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:32.802495 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e3a84e14-bea4-42f5-9d0d-9c2100076b04 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:32.802912 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e3a84e14-bea4-42f5-9d0d-9c2100076b04 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:32.803681 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e3a84e14-bea4-42f5-9d0d-9c2100076b04 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:32.804123 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e3a84e14-bea4-42f5-9d0d-9c2100076b04 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:32.817570 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-e3a84e14-bea4-42f5-9d0d-9c2100076b04 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] HTTP exception thrown: Instance d413ebb5-7e19-40ba-810b-505e89c582ef could not be found. May 23 16:51:32.819178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e3a84e14-bea4-42f5-9d0d-9c2100076b04 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Request method failure captured: May 23 16:51:32.819178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef HTTP/1.1 May 23 16:51:32.819178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:51:32.819178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:51:32.819178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:51:32.819178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:51:32.819178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:51:32.819178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:51:32.819178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:51:32.819178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:51:32.819178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7oyo5VTSnwIFQPT0kTtFaHtIkHFj5L-FdhSIUmX9rttwLCW8jCAZ-X2qSMb7H2nHSgXjB6vWffoOpo-tnDcGctqzpOOjedHQxhH_K6_YUurOv1U6F0vB3iEbd4WjdXEZ7YlGpKqnMbRleSlAkItJeye3e1UHY4m4KuLnUpITA6zvao May 23 16:51:32.819178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:51:32.819178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:51:32.819178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:51:32.819178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:51:32.819178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:51:32.819178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:51:32.819178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:51:32.819178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:51:32.819178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:51:32.819178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:51:32.820661 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:51:32.820661 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:51:32.820661 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:51:32.820661 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:51:32.820661 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:51:32.820661 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:51:32.820661 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:51:32.820661 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: 718a82d2f4294f68965ce01aac0fc166 May 23 16:51:32.820661 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:51:32.820661 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 16:51:32.820661 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Instance d413ebb5-7e19-40ba-810b-505e89c582ef could not be found. May 23 16:51:32.820661 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': 'd413ebb5-7e19-40ba-810b-505e89c582ef'} May 23 16:51:32.821479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:51:32.821479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:51:32.821479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:51:32.821479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:51:32.821479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:51:32.821479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:51:32.821479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:51:32.821479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:51:32.821479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:51:32.821479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:51:32.821479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d413ebb5-7e19-40ba-810b-505e89c582ef could not be found. May 23 16:51:32.821479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:51:32.821479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:51:32.821479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:51:32.821479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:51:32.821479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:51:32.821479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:51:32.821479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:51:32.821479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:51:32.821479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:51:32.822751 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:51:32.822751 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:51:32.822751 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:51:32.822751 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:51:32.822751 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:51:32.822751 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:51:32.822751 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:51:32.822751 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d413ebb5-7e19-40ba-810b-505e89c582ef could not be found. May 23 16:51:32.822751 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:51:32.822751 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:51:32.822751 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:51:32.822751 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:51:32.822751 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:51:32.822751 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:51:32.822751 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:51:32.822751 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:51:32.822751 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d413ebb5-7e19-40ba-810b-505e89c582ef could not be found. May 23 16:51:32.822751 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:51:32.824012 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e3a84e14-bea4-42f5-9d0d-9c2100076b04 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Returning 404 to user: Instance d413ebb5-7e19-40ba-810b-505e89c582ef could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:51:32.824012 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e3a84e14-bea4-42f5-9d0d-9c2100076b04 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 404 len: 111 microversion: 2.1 time: 0.029708 May 23 16:51:32.824012 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 286/544] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:32 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:51:32.829635 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-d5229953-3dac-4501-9408-63fe5cbd3f15 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '.version_select at 0x7f224c4eaf70>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:32.910077 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-d5229953-3dac-4501-9408-63fe5cbd3f15 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-120995086" status: 202 len: 0 microversion: 2.1 time: 0.084479 May 23 16:51:32.912186 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 259/545] 10.222.0.74 () {58 vars in 1217 bytes} [Mon May 23 16:51:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-120995086 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:51:33.968023 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-5a9fb70e-9204-49df-8493-ba41e09c48fc tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:33.968613 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-5a9fb70e-9204-49df-8493-ba41e09c48fc tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:33.974971 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5a9fb70e-9204-49df-8493-ba41e09c48fc tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:33.975441 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5a9fb70e-9204-49df-8493-ba41e09c48fc tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:33.976206 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5a9fb70e-9204-49df-8493-ba41e09c48fc tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:33.976678 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5a9fb70e-9204-49df-8493-ba41e09c48fc tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:34.055479 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.objects.instance [None req-5a9fb70e-9204-49df-8493-ba41e09c48fc tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lazy-loading 'services' on Instance uuid ead45718-a5be-4d14-a83c-b6101b5ebc3c {{(pid=124715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:51:34.290681 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-5a9fb70e-9204-49df-8493-ba41e09c48fc tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "DELETE /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c/os-volume_attachments/7417567b-3164-4149-8f79-7b61459536f3" status: 202 len: 0 microversion: 2.1 time: 0.326411 May 23 16:51:34.291300 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 287/546] 10.222.0.74 () {58 vars in 1415 bytes} [Mon May 23 16:51:33 2022] DELETE /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c/os-volume_attachments/7417567b-3164-4149-8f79-7b61459536f3 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:51:34.301025 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-486a74f3-107a-41a0-ba12-6abf5640a8dc tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:34.303208 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-486a74f3-107a-41a0-ba12-6abf5640a8dc tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:34.309121 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-486a74f3-107a-41a0-ba12-6abf5640a8dc tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:34.309569 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-486a74f3-107a-41a0-ba12-6abf5640a8dc tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:34.310350 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-486a74f3-107a-41a0-ba12-6abf5640a8dc tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:34.310800 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-486a74f3-107a-41a0-ba12-6abf5640a8dc tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:34.341408 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-486a74f3-107a-41a0-ba12-6abf5640a8dc tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044972 May 23 16:51:34.342486 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 260/547] 10.222.0.74 () {58 vars in 1301 bytes} [Mon May 23 16:51:34 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:51:35.354449 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-03dea00a-19da-45e8-91ec-a74884dd5cba tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:35.355648 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-03dea00a-19da-45e8-91ec-a74884dd5cba tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:35.363668 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-03dea00a-19da-45e8-91ec-a74884dd5cba tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:35.364113 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-03dea00a-19da-45e8-91ec-a74884dd5cba tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:35.364931 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-03dea00a-19da-45e8-91ec-a74884dd5cba tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:35.365362 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-03dea00a-19da-45e8-91ec-a74884dd5cba tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:35.396049 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-03dea00a-19da-45e8-91ec-a74884dd5cba tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046076 May 23 16:51:35.396630 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 288/548] 10.222.0.74 () {58 vars in 1301 bytes} [Mon May 23 16:51:35 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:51:36.407993 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-2dd99090-7d75-4e5d-95d9-86c007323807 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:36.408948 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-2dd99090-7d75-4e5d-95d9-86c007323807 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:36.415341 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2dd99090-7d75-4e5d-95d9-86c007323807 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:36.419212 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2dd99090-7d75-4e5d-95d9-86c007323807 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:36.419212 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2dd99090-7d75-4e5d-95d9-86c007323807 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:36.419212 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2dd99090-7d75-4e5d-95d9-86c007323807 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:36.445187 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-2dd99090-7d75-4e5d-95d9-86c007323807 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042012 May 23 16:51:36.445699 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 261/549] 10.222.0.74 () {58 vars in 1301 bytes} [Mon May 23 16:51:36 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 16:51:36.504287 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-fef06311-36f4-4e35-ba62-18c23eecdd3c tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:36.504785 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-fef06311-36f4-4e35-ba62-18c23eecdd3c tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:36.511157 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fef06311-36f4-4e35-ba62-18c23eecdd3c tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:36.511598 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fef06311-36f4-4e35-ba62-18c23eecdd3c tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:36.512387 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fef06311-36f4-4e35-ba62-18c23eecdd3c tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:36.512823 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fef06311-36f4-4e35-ba62-18c23eecdd3c tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:36.517070 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:51:36.540423 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-fef06311-36f4-4e35-ba62-18c23eecdd3c tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Going to try to terminate instance {{(pid=124715) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 16:51:36.829075 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-fef06311-36f4-4e35-ba62-18c23eecdd3c tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "DELETE /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 204 len: 0 microversion: 2.1 time: 0.328105 May 23 16:51:36.829654 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 289/550] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 16:51:36 2022] DELETE /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 16:51:36.838314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-18eeae5c-a92f-44da-9a7c-a0483d104a68 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:36.838931 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-18eeae5c-a92f-44da-9a7c-a0483d104a68 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:36.845623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-18eeae5c-a92f-44da-9a7c-a0483d104a68 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:36.846078 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-18eeae5c-a92f-44da-9a7c-a0483d104a68 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:36.846847 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-18eeae5c-a92f-44da-9a7c-a0483d104a68 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:36.847291 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-18eeae5c-a92f-44da-9a7c-a0483d104a68 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:36.977673 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-18eeae5c-a92f-44da-9a7c-a0483d104a68 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:36.985790 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-18eeae5c-a92f-44da-9a7c-a0483d104a68 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1684 microversion: 2.1 time: 0.151525 May 23 16:51:36.986358 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 262/551] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:36 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:38.003792 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-30f2344b-97f5-4f34-94d5-e7301ff87181 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:38.004578 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-30f2344b-97f5-4f34-94d5-e7301ff87181 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:38.011101 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30f2344b-97f5-4f34-94d5-e7301ff87181 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:38.011549 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30f2344b-97f5-4f34-94d5-e7301ff87181 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:38.012406 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30f2344b-97f5-4f34-94d5-e7301ff87181 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:38.012841 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30f2344b-97f5-4f34-94d5-e7301ff87181 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:38.228596 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-30f2344b-97f5-4f34-94d5-e7301ff87181 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:38.236722 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-30f2344b-97f5-4f34-94d5-e7301ff87181 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1684 microversion: 2.1 time: 0.237093 May 23 16:51:38.237561 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 290/552] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:37 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1684 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:51:39.064733 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-cf432466-0a7d-445e-8f85-ac3b8c18d227 req-ecb6ed97-73fb-4f4c-9312-3afe035d8426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead45718-a5be-4d14-a83c-b6101b5ebc3c", "name": "network-vif-deleted", "tag": "9b6b2933-3180-4c87-a5e7-c75a56eb9704"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:51:39.073694 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-cf432466-0a7d-445e-8f85-ac3b8c18d227 req-ecb6ed97-73fb-4f4c-9312-3afe035d8426 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:39.074178 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-cf432466-0a7d-445e-8f85-ac3b8c18d227 req-ecb6ed97-73fb-4f4c-9312-3afe035d8426 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:39.088888 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-cf432466-0a7d-445e-8f85-ac3b8c18d227 req-ecb6ed97-73fb-4f4c-9312-3afe035d8426 service nova] Creating event network-vif-deleted:9b6b2933-3180-4c87-a5e7-c75a56eb9704 for instance ead45718-a5be-4d14-a83c-b6101b5ebc3c on hv-cinder-83925 May 23 16:51:39.094708 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-cf432466-0a7d-445e-8f85-ac3b8c18d227 req-ecb6ed97-73fb-4f4c-9312-3afe035d8426 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034889 May 23 16:51:39.095365 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 263/553] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:51:39.256877 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-404e62af-3b69-45cb-8fde-8e70c443cce2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:39.258306 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-404e62af-3b69-45cb-8fde-8e70c443cce2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:39.267143 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-404e62af-3b69-45cb-8fde-8e70c443cce2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:39.273852 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-404e62af-3b69-45cb-8fde-8e70c443cce2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:39.275063 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-404e62af-3b69-45cb-8fde-8e70c443cce2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:39.275736 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-404e62af-3b69-45cb-8fde-8e70c443cce2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:39.343842 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-404e62af-3b69-45cb-8fde-8e70c443cce2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:39.351789 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-404e62af-3b69-45cb-8fde-8e70c443cce2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 200 len: 1327 microversion: 2.1 time: 0.101305 May 23 16:51:39.352343 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 291/554] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:39 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:40.369760 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-9a5f9e93-ceea-475f-a20a-118ce9332dc2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:40.370388 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-9a5f9e93-ceea-475f-a20a-118ce9332dc2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:40.377181 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9a5f9e93-ceea-475f-a20a-118ce9332dc2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:40.377626 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9a5f9e93-ceea-475f-a20a-118ce9332dc2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:40.378384 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9a5f9e93-ceea-475f-a20a-118ce9332dc2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:40.378821 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9a5f9e93-ceea-475f-a20a-118ce9332dc2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:40.392621 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-9a5f9e93-ceea-475f-a20a-118ce9332dc2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] HTTP exception thrown: Instance ead45718-a5be-4d14-a83c-b6101b5ebc3c could not be found. May 23 16:51:40.394194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-9a5f9e93-ceea-475f-a20a-118ce9332dc2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Request method failure captured: May 23 16:51:40.394194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c HTTP/1.1 May 23 16:51:40.394194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:51:40.394194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:51:40.394194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:51:40.394194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 16:51:40.394194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:51:40.394194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:51:40.394194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:51:40.394194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:51:40.394194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7oyo5VTSnwIFQPT0kTtFaHtIkHFj5L-FdhSIUmX9rttwLCW8jCAZ-X2qSMb7H2nHSgXjB6vWffoOpo-tnDcGctqzpOOjedHQxhH_K6_YUurOv1U6F0vB3iEbd4WjdXEZ7YlGpKqnMbRleSlAkItJeye3e1UHY4m4KuLnUpITA6zvao May 23 16:51:40.394194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:51:40.394194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:51:40.394194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:51:40.394194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:51:40.394194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:51:40.394194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:51:40.394194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:51:40.394194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:51:40.394194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:51:40.394194 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:51:40.395641 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:51:40.395641 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:51:40.395641 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:51:40.395641 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:51:40.395641 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:51:40.395641 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:51:40.395641 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:51:40.395641 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 718a82d2f4294f68965ce01aac0fc166 May 23 16:51:40.395641 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:51:40.395641 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: > May 23 16:51:40.395641 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Instance ead45718-a5be-4d14-a83c-b6101b5ebc3c could not be found. May 23 16:51:40.395641 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': 'ead45718-a5be-4d14-a83c-b6101b5ebc3c'} May 23 16:51:40.399489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:51:40.399489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:51:40.399489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:51:40.399489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:51:40.399489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:51:40.399489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:51:40.399489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:51:40.399489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:51:40.399489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:51:40.399489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:51:40.399489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ead45718-a5be-4d14-a83c-b6101b5ebc3c could not be found. May 23 16:51:40.399489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:51:40.399489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:51:40.399489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:51:40.399489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:51:40.399489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:51:40.399489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:51:40.399489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:51:40.399489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:51:40.399489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:51:40.400909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:51:40.400909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:51:40.400909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:51:40.400909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:51:40.400909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:51:40.400909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:51:40.400909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:51:40.400909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ead45718-a5be-4d14-a83c-b6101b5ebc3c could not be found. May 23 16:51:40.400909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:51:40.400909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:51:40.400909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:51:40.400909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:51:40.400909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:51:40.400909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:51:40.400909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:51:40.400909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:51:40.400909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ead45718-a5be-4d14-a83c-b6101b5ebc3c could not be found. May 23 16:51:40.400909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:51:40.402163 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-9a5f9e93-ceea-475f-a20a-118ce9332dc2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Returning 404 to user: Instance ead45718-a5be-4d14-a83c-b6101b5ebc3c could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:51:40.402163 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-9a5f9e93-ceea-475f-a20a-118ce9332dc2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 404 len: 111 microversion: 2.1 time: 0.030642 May 23 16:51:40.402163 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 264/555] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:40 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:51:40.404329 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-cad73615-3d38-478a-92a8-353a3e10260d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '.version_select at 0x7f224c551c10>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:40.469553 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-cad73615-3d38-478a-92a8-353a3e10260d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1659597792" status: 202 len: 0 microversion: 2.1 time: 0.069054 May 23 16:51:40.470131 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 292/556] 10.222.0.74 () {58 vars in 1220 bytes} [Mon May 23 16:51:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1659597792 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:51:40.737179 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-f55fe76e-3a1b-4840-9a38-2215d598190d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:40.737763 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-f55fe76e-3a1b-4840-9a38-2215d598190d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:40.743952 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f55fe76e-3a1b-4840-9a38-2215d598190d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:40.749482 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f55fe76e-3a1b-4840-9a38-2215d598190d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:40.749482 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f55fe76e-3a1b-4840-9a38-2215d598190d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:40.749482 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f55fe76e-3a1b-4840-9a38-2215d598190d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:40.881736 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.objects.instance [None req-f55fe76e-3a1b-4840-9a38-2215d598190d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lazy-loading 'services' on Instance uuid 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 {{(pid=124714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:51:41.164909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-f55fe76e-3a1b-4840-9a38-2215d598190d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "DELETE /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4/os-volume_attachments/77cfd71f-5637-4839-b03e-e0581af6aee0" status: 202 len: 0 microversion: 2.1 time: 0.551461 May 23 16:51:41.165765 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 265/557] 10.222.0.74 () {58 vars in 1415 bytes} [Mon May 23 16:51:40 2022] DELETE /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4/os-volume_attachments/77cfd71f-5637-4839-b03e-e0581af6aee0 => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:51:41.479823 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-5db7e409-5ff4-4dd2-b261-07e53a3b497d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Action: 'create', calling method: .version_select at 0x7f224c4c3c10>, body: {"keypair": {"name": "tempest-keypair-165593506", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmFdlDK2dF0Bq1O6HsZV12OfmU38t4lNZbf7vYressVfuA4pYMJ52FckEB4pkutCKrk33PwzEqazFvPRzQ829RN4TUhn0bLvGwmxYAuGSbHs6fKfyeqGgtflbOSWp8FSg=="}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:51:41.493957 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-5db7e409-5ff4-4dd2-b261-07e53a3b497d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Getting quotas for project e293f2b3de9143ad9e8a1fe8b67d6641. Resources: {'key_pairs'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:51:41.497734 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-5db7e409-5ff4-4dd2-b261-07e53a3b497d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Getting quotas for user 718a82d2f4294f68965ce01aac0fc166 and project e293f2b3de9143ad9e8a1fe8b67d6641. Resources: {'key_pairs'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:51:41.572562 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-5db7e409-5ff4-4dd2-b261-07e53a3b497d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.097181 May 23 16:51:41.577355 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 293/558] 10.222.0.74 () {60 vars in 1158 bytes} [Mon May 23 16:51:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:51:42.292112 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-a7d4f730-ffa6-48ef-ab36-738031de321e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:51:42.300037 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a7d4f730-ffa6-48ef-ab36-738031de321e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:42.300515 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a7d4f730-ffa6-48ef-ab36-738031de321e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:42.322042 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-a7d4f730-ffa6-48ef-ab36-738031de321e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Going to try to stop instance {{(pid=124714) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 23 16:51:42.517260 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-a7d4f730-ffa6-48ef-ab36-738031de321e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "POST /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4/action" status: 202 len: 0 microversion: 2.1 time: 0.229667 May 23 16:51:42.517907 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 266/559] 10.222.0.74 () {60 vars in 1277 bytes} [Mon May 23 16:51:42 2022] POST /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:51:42.526697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-2067a9bd-bdbe-47f8-95e9-6e86df1286a3 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:42.527321 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-2067a9bd-bdbe-47f8-95e9-6e86df1286a3 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:42.549442 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2067a9bd-bdbe-47f8-95e9-6e86df1286a3 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:42.549442 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2067a9bd-bdbe-47f8-95e9-6e86df1286a3 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:42.549442 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2067a9bd-bdbe-47f8-95e9-6e86df1286a3 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:42.549442 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2067a9bd-bdbe-47f8-95e9-6e86df1286a3 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:42.695435 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-2067a9bd-bdbe-47f8-95e9-6e86df1286a3 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:42.703003 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-2067a9bd-bdbe-47f8-95e9-6e86df1286a3 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1677 microversion: 2.1 time: 0.180832 May 23 16:51:42.703565 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 294/560] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:42 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1677 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:43.722891 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-3341f175-319b-48f9-bfdb-4621c7d1fe0b tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:43.723584 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-3341f175-319b-48f9-bfdb-4621c7d1fe0b tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:43.729933 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3341f175-319b-48f9-bfdb-4621c7d1fe0b tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:43.730376 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3341f175-319b-48f9-bfdb-4621c7d1fe0b tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:43.731238 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3341f175-319b-48f9-bfdb-4621c7d1fe0b tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:43.731669 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3341f175-319b-48f9-bfdb-4621c7d1fe0b tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:43.799148 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-00ad5310-fcaf-4d85-bf94-9f5ffced85ba tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1859885441", "imageRef": "96972e76-879d-4149-a713-a94529892aad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18a683c4-5441-4a3c-96d0-ecf1b626575e"}], "security_groups": [{"name": "tempest-securitygroup--1832133377"}], "key_name": "tempest-keypair-165593506", "user_data": "}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:51:43.896260 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-3341f175-319b-48f9-bfdb-4621c7d1fe0b tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:43.903787 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-3341f175-319b-48f9-bfdb-4621c7d1fe0b tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1677 microversion: 2.1 time: 0.185601 May 23 16:51:43.904523 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 267/561] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:43 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1677 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:43.924972 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.network.neutron [None req-00ad5310-fcaf-4d85-bf94-9f5ffced85ba tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] validate_networks() for [('18a683c4-5441-4a3c-96d0-ecf1b626575e', None, None, None, None, None)] {{(pid=124715) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 16:51:44.322775 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-00ad5310-fcaf-4d85-bf94-9f5ffced85ba tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Flavor limits 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 16:51:44.323204 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-00ad5310-fcaf-4d85-bf94-9f5ffced85ba tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Image limits 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 16:51:44.323683 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-00ad5310-fcaf-4d85-bf94-9f5ffced85ba tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Flavor pref 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 16:51:44.324134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-00ad5310-fcaf-4d85-bf94-9f5ffced85ba tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Image pref 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 16:51:44.324574 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-00ad5310-fcaf-4d85-bf94-9f5ffced85ba tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 16:51:44.333445 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-00ad5310-fcaf-4d85-bf94-9f5ffced85ba tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:44.333896 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-00ad5310-fcaf-4d85-bf94-9f5ffced85ba tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:44.334951 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-00ad5310-fcaf-4d85-bf94-9f5ffced85ba tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:44.335392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-00ad5310-fcaf-4d85-bf94-9f5ffced85ba tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:44.352123 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-00ad5310-fcaf-4d85-bf94-9f5ffced85ba tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Getting quotas for project e293f2b3de9143ad9e8a1fe8b67d6641. Resources: {'cores', 'instances', 'ram'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:51:44.356052 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-00ad5310-fcaf-4d85-bf94-9f5ffced85ba tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Getting quotas for user 718a82d2f4294f68965ce01aac0fc166 and project e293f2b3de9143ad9e8a1fe8b67d6641. Resources: {'cores', 'instances', 'ram'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:51:44.367115 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-00ad5310-fcaf-4d85-bf94-9f5ffced85ba tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Going to run 1 instances... {{(pid=124715) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 16:51:44.369388 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-00ad5310-fcaf-4d85-bf94-9f5ffced85ba tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96972e76-879d-4149-a713-a94529892aad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 16:51:44.476854 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-00ad5310-fcaf-4d85-bf94-9f5ffced85ba tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.681972 May 23 16:51:44.477617 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 295/562] 10.222.0.74 () {60 vars in 1146 bytes} [Mon May 23 16:51:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 16:51:44.487631 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-30ee2f17-b489-4ed3-b78a-71f73b5b3342 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:44.488334 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-30ee2f17-b489-4ed3-b78a-71f73b5b3342 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:44.545892 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-30ee2f17-b489-4ed3-b78a-71f73b5b3342 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:44.552568 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-30ee2f17-b489-4ed3-b78a-71f73b5b3342 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1" status: 200 len: 1241 microversion: 2.1 time: 0.068639 May 23 16:51:44.553132 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 268/563] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:44 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:44.921622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-85d915aa-136a-4c46-a25c-ec177866fda7 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:44.922243 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-85d915aa-136a-4c46-a25c-ec177866fda7 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:44.929178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-85d915aa-136a-4c46-a25c-ec177866fda7 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:44.929634 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-85d915aa-136a-4c46-a25c-ec177866fda7 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:44.930409 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-85d915aa-136a-4c46-a25c-ec177866fda7 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:44.930861 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-85d915aa-136a-4c46-a25c-ec177866fda7 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:45.060861 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-85d915aa-136a-4c46-a25c-ec177866fda7 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:45.068959 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-85d915aa-136a-4c46-a25c-ec177866fda7 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1677 microversion: 2.1 time: 0.152227 May 23 16:51:45.069540 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 296/564] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:44 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:51:45.569492 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-109ba798-5184-4b82-80b0-fa48df571b7d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:45.570116 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-109ba798-5184-4b82-80b0-fa48df571b7d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:45.577241 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-109ba798-5184-4b82-80b0-fa48df571b7d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:45.577731 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-109ba798-5184-4b82-80b0-fa48df571b7d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:45.578532 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-109ba798-5184-4b82-80b0-fa48df571b7d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:45.578972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-109ba798-5184-4b82-80b0-fa48df571b7d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:45.639162 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-109ba798-5184-4b82-80b0-fa48df571b7d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:45.646589 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-109ba798-5184-4b82-80b0-fa48df571b7d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1" status: 200 len: 1237 microversion: 2.1 time: 0.080964 May 23 16:51:45.647180 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 269/565] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:45 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:46.086786 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-36dde3f0-9ae8-4bb8-b0e8-860b5157d156 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:46.087411 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-36dde3f0-9ae8-4bb8-b0e8-860b5157d156 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:46.094565 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-36dde3f0-9ae8-4bb8-b0e8-860b5157d156 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:46.095022 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-36dde3f0-9ae8-4bb8-b0e8-860b5157d156 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:46.095828 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-36dde3f0-9ae8-4bb8-b0e8-860b5157d156 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:46.096270 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-36dde3f0-9ae8-4bb8-b0e8-860b5157d156 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:46.233453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-36dde3f0-9ae8-4bb8-b0e8-860b5157d156 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:46.240929 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-36dde3f0-9ae8-4bb8-b0e8-860b5157d156 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1677 microversion: 2.1 time: 0.158453 May 23 16:51:46.241494 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 297/566] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:46 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:46.663504 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-c9cb96f0-3a17-468e-bc30-15d66dcb1850 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:46.664256 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-c9cb96f0-3a17-468e-bc30-15d66dcb1850 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:46.671039 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c9cb96f0-3a17-468e-bc30-15d66dcb1850 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:46.671494 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c9cb96f0-3a17-468e-bc30-15d66dcb1850 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:46.672320 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c9cb96f0-3a17-468e-bc30-15d66dcb1850 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:46.672761 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c9cb96f0-3a17-468e-bc30-15d66dcb1850 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:46.757047 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-c9cb96f0-3a17-468e-bc30-15d66dcb1850 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:46.764883 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-c9cb96f0-3a17-468e-bc30-15d66dcb1850 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1" status: 200 len: 1299 microversion: 2.1 time: 0.105378 May 23 16:51:46.765458 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 270/567] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:46 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:47.258279 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e4b56a3a-9a77-4c68-9006-c4c1b9ad75d9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:47.258959 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e4b56a3a-9a77-4c68-9006-c4c1b9ad75d9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:47.266265 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e4b56a3a-9a77-4c68-9006-c4c1b9ad75d9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:47.266981 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e4b56a3a-9a77-4c68-9006-c4c1b9ad75d9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:47.267922 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e4b56a3a-9a77-4c68-9006-c4c1b9ad75d9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:47.268546 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e4b56a3a-9a77-4c68-9006-c4c1b9ad75d9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:47.530113 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e4b56a3a-9a77-4c68-9006-c4c1b9ad75d9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:47.537703 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e4b56a3a-9a77-4c68-9006-c4c1b9ad75d9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1677 microversion: 2.1 time: 0.283491 May 23 16:51:47.538279 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 298/568] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:47 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1677 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:47.782128 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-6fc77cd2-5569-42fa-99c4-8ce7898c06d4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:47.782749 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-6fc77cd2-5569-42fa-99c4-8ce7898c06d4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:47.789372 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6fc77cd2-5569-42fa-99c4-8ce7898c06d4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:47.789816 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6fc77cd2-5569-42fa-99c4-8ce7898c06d4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:47.790587 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6fc77cd2-5569-42fa-99c4-8ce7898c06d4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:47.791021 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6fc77cd2-5569-42fa-99c4-8ce7898c06d4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:47.983674 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-6fc77cd2-5569-42fa-99c4-8ce7898c06d4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:47.991096 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-6fc77cd2-5569-42fa-99c4-8ce7898c06d4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1" status: 200 len: 1367 microversion: 2.1 time: 0.213198 May 23 16:51:47.991675 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 271/569] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:47 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:48.080210 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-18b8b879-5b68-4203-b33b-75c43157bf6e req-c68ef3d6-0cea-49bd-acfd-634bcb65b645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5df1e0c9-37f3-4752-9e82-553588ceb0b1", "tag": "f6effdfe-d86e-4a82-a12c-07ea95a8abf1"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:51:48.084665 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:51:48.090026 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-18b8b879-5b68-4203-b33b-75c43157bf6e req-c68ef3d6-0cea-49bd-acfd-634bcb65b645 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:48.090561 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-18b8b879-5b68-4203-b33b-75c43157bf6e req-c68ef3d6-0cea-49bd-acfd-634bcb65b645 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:48.103173 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-18b8b879-5b68-4203-b33b-75c43157bf6e req-c68ef3d6-0cea-49bd-acfd-634bcb65b645 service nova] Creating event network-changed:f6effdfe-d86e-4a82-a12c-07ea95a8abf1 for instance 5df1e0c9-37f3-4752-9e82-553588ceb0b1 on hv-cinder-83925 May 23 16:51:48.109672 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-18b8b879-5b68-4203-b33b-75c43157bf6e req-c68ef3d6-0cea-49bd-acfd-634bcb65b645 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033602 May 23 16:51:48.110279 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 299/570] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:51:48.554927 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ee988423-7b45-47e6-ae8b-2048e95496c1 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:48.555546 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ee988423-7b45-47e6-ae8b-2048e95496c1 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:48.561734 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ee988423-7b45-47e6-ae8b-2048e95496c1 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:48.562193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ee988423-7b45-47e6-ae8b-2048e95496c1 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:48.562975 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ee988423-7b45-47e6-ae8b-2048e95496c1 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:48.563420 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ee988423-7b45-47e6-ae8b-2048e95496c1 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:48.762248 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ee988423-7b45-47e6-ae8b-2048e95496c1 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:48.770491 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ee988423-7b45-47e6-ae8b-2048e95496c1 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1677 microversion: 2.1 time: 0.219422 May 23 16:51:48.771073 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 272/571] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:48 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:49.009220 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-9e7bd15a-c943-4256-ac07-6a9698d58efb tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:49.010061 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-9e7bd15a-c943-4256-ac07-6a9698d58efb tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:49.017611 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9e7bd15a-c943-4256-ac07-6a9698d58efb tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:49.018098 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9e7bd15a-c943-4256-ac07-6a9698d58efb tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:49.018887 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9e7bd15a-c943-4256-ac07-6a9698d58efb tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:49.019324 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9e7bd15a-c943-4256-ac07-6a9698d58efb tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:49.379130 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-9e7bd15a-c943-4256-ac07-6a9698d58efb tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:49.386600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-9e7bd15a-c943-4256-ac07-6a9698d58efb tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1" status: 200 len: 1367 microversion: 2.1 time: 0.382505 May 23 16:51:49.387200 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 300/572] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:49 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 => generated 1367 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:49.788056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-3e5200b7-2a08-4d23-8142-54f87aa49f7e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:49.788719 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-3e5200b7-2a08-4d23-8142-54f87aa49f7e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:49.795706 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3e5200b7-2a08-4d23-8142-54f87aa49f7e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:49.796151 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3e5200b7-2a08-4d23-8142-54f87aa49f7e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:49.796943 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3e5200b7-2a08-4d23-8142-54f87aa49f7e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:49.797384 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3e5200b7-2a08-4d23-8142-54f87aa49f7e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:49.923505 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-3e5200b7-2a08-4d23-8142-54f87aa49f7e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:49.930915 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-3e5200b7-2a08-4d23-8142-54f87aa49f7e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1677 microversion: 2.1 time: 0.146711 May 23 16:51:49.931486 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 273/573] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:49 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:50.403919 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e71524e3-d98c-473a-b1f3-438fd2af477f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:50.404576 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e71524e3-d98c-473a-b1f3-438fd2af477f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:50.411668 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e71524e3-d98c-473a-b1f3-438fd2af477f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:50.412128 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e71524e3-d98c-473a-b1f3-438fd2af477f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:50.412939 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e71524e3-d98c-473a-b1f3-438fd2af477f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:50.413381 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e71524e3-d98c-473a-b1f3-438fd2af477f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:50.541083 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e71524e3-d98c-473a-b1f3-438fd2af477f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:50.549110 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e71524e3-d98c-473a-b1f3-438fd2af477f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1" status: 200 len: 1367 microversion: 2.1 time: 0.149028 May 23 16:51:50.549668 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 301/574] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:50 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:51:50.948826 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-abb10254-a86c-4de2-a9f7-c9d1b8f5c167 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:50.949472 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-abb10254-a86c-4de2-a9f7-c9d1b8f5c167 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:50.956216 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-abb10254-a86c-4de2-a9f7-c9d1b8f5c167 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:50.956696 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-abb10254-a86c-4de2-a9f7-c9d1b8f5c167 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:50.957453 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-abb10254-a86c-4de2-a9f7-c9d1b8f5c167 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:50.957886 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-abb10254-a86c-4de2-a9f7-c9d1b8f5c167 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:51.085642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-abb10254-a86c-4de2-a9f7-c9d1b8f5c167 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:51.093695 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-abb10254-a86c-4de2-a9f7-c9d1b8f5c167 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1677 microversion: 2.1 time: 0.148705 May 23 16:51:51.094317 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 274/575] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:50 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:51.565592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e8428c77-d9b4-4607-a7cd-8c5b700a06c0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:51.566210 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e8428c77-d9b4-4607-a7cd-8c5b700a06c0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:51.572730 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e8428c77-d9b4-4607-a7cd-8c5b700a06c0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:51.573186 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e8428c77-d9b4-4607-a7cd-8c5b700a06c0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:51.573954 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e8428c77-d9b4-4607-a7cd-8c5b700a06c0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:51.574396 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e8428c77-d9b4-4607-a7cd-8c5b700a06c0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:51.703182 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e8428c77-d9b4-4607-a7cd-8c5b700a06c0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:51.710906 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e8428c77-d9b4-4607-a7cd-8c5b700a06c0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1" status: 200 len: 1367 microversion: 2.1 time: 0.149224 May 23 16:51:51.711476 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 302/576] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:51 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:52.110404 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-19f45add-6f47-497b-8b43-1fda077059f6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:52.111026 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-19f45add-6f47-497b-8b43-1fda077059f6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:52.117603 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-19f45add-6f47-497b-8b43-1fda077059f6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:52.118059 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-19f45add-6f47-497b-8b43-1fda077059f6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:52.118827 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-19f45add-6f47-497b-8b43-1fda077059f6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:52.119271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-19f45add-6f47-497b-8b43-1fda077059f6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:52.121975 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:51:52.248997 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-19f45add-6f47-497b-8b43-1fda077059f6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:52.256768 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-19f45add-6f47-497b-8b43-1fda077059f6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1677 microversion: 2.1 time: 0.150412 May 23 16:51:52.257351 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 275/577] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:52 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:52.728198 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a3bab1e5-bfb5-4ed4-af96-401d193ed04b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:52.728899 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a3bab1e5-bfb5-4ed4-af96-401d193ed04b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:52.735811 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a3bab1e5-bfb5-4ed4-af96-401d193ed04b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:52.736258 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a3bab1e5-bfb5-4ed4-af96-401d193ed04b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:52.737042 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a3bab1e5-bfb5-4ed4-af96-401d193ed04b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:52.737475 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a3bab1e5-bfb5-4ed4-af96-401d193ed04b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:52.868854 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a3bab1e5-bfb5-4ed4-af96-401d193ed04b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:52.877428 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a3bab1e5-bfb5-4ed4-af96-401d193ed04b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1" status: 200 len: 1367 microversion: 2.1 time: 0.152965 May 23 16:51:52.881232 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 303/578] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:52 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:53.251820 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-5c07e67d-935f-489e-af46-8a5cf14d7f6b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:53.252352 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-5c07e67d-935f-489e-af46-8a5cf14d7f6b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:53.258385 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-5c07e67d-935f-489e-af46-8a5cf14d7f6b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:53.258843 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-5c07e67d-935f-489e-af46-8a5cf14d7f6b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:53.259601 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-5c07e67d-935f-489e-af46-8a5cf14d7f6b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:53.260035 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-5c07e67d-935f-489e-af46-8a5cf14d7f6b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:53.273742 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-5c46a7a7-7534-49ce-a2c9-e69b99ebafc0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:53.274485 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-5c46a7a7-7534-49ce-a2c9-e69b99ebafc0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:53.280579 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5c46a7a7-7534-49ce-a2c9-e69b99ebafc0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:53.281039 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5c46a7a7-7534-49ce-a2c9-e69b99ebafc0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:53.281861 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5c46a7a7-7534-49ce-a2c9-e69b99ebafc0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:53.282304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5c46a7a7-7534-49ce-a2c9-e69b99ebafc0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:53.289059 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-5c07e67d-935f-489e-af46-8a5cf14d7f6b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357/os-volume_attachments/8fad954f-3792-459b-bd53-fa13fe7de3d6" status: 200 len: 194 microversion: 2.20 time: 0.141877 May 23 16:51:53.289929 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 276/579] 10.222.0.74 () {60 vars in 1453 bytes} [Mon May 23 16:51:53 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357/os-volume_attachments/8fad954f-3792-459b-bd53-fa13fe7de3d6 => generated 194 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 16:51:53.353733 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-7726096f-e3ee-4011-90ed-5f37364bb423 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:53.354235 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-7726096f-e3ee-4011-90ed-5f37364bb423 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:53.361319 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7726096f-e3ee-4011-90ed-5f37364bb423 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:53.361936 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7726096f-e3ee-4011-90ed-5f37364bb423 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:53.362772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7726096f-e3ee-4011-90ed-5f37364bb423 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:53.363222 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7726096f-e3ee-4011-90ed-5f37364bb423 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:53.414689 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-5c46a7a7-7534-49ce-a2c9-e69b99ebafc0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:53.422434 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-5c46a7a7-7534-49ce-a2c9-e69b99ebafc0 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1654 microversion: 2.1 time: 0.152529 May 23 16:51:53.423015 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 304/580] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:53 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:51:53.438684 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-45e89ff6-6350-4fc7-b0ee-1c8a73b25c41 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:51:53.444770 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-45e89ff6-6350-4fc7-b0ee-1c8a73b25c41 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:53.445228 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-45e89ff6-6350-4fc7-b0ee-1c8a73b25c41 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:53.445352 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.objects.instance [None req-7726096f-e3ee-4011-90ed-5f37364bb423 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lazy-loading 'services' on Instance uuid bb302c29-c30d-4ffa-af9d-1f226fd56357 {{(pid=124714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:51:53.468423 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-45e89ff6-6350-4fc7-b0ee-1c8a73b25c41 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Going to try to start instance {{(pid=124715) start /opt/stack/nova/nova/compute/api.py:2730}} May 23 16:51:53.614197 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-45e89ff6-6350-4fc7-b0ee-1c8a73b25c41 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "POST /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4/action" status: 202 len: 0 microversion: 2.1 time: 0.179277 May 23 16:51:53.614797 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 305/581] 10.222.0.74 () {60 vars in 1277 bytes} [Mon May 23 16:51:53 2022] POST /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 16:51:53.623770 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-efc1d4cb-24de-400a-aa06-7033996116bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:53.624527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-efc1d4cb-24de-400a-aa06-7033996116bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:53.630780 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-efc1d4cb-24de-400a-aa06-7033996116bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:53.636032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-efc1d4cb-24de-400a-aa06-7033996116bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:53.636032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-efc1d4cb-24de-400a-aa06-7033996116bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:53.636032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-efc1d4cb-24de-400a-aa06-7033996116bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:53.650759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:51:53.656845 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-7726096f-e3ee-4011-90ed-5f37364bb423 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "DELETE /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357/os-volume_attachments/8fad954f-3792-459b-bd53-fa13fe7de3d6" status: 202 len: 0 microversion: 2.20 time: 0.306937 May 23 16:51:53.661223 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 277/582] 10.222.0.74 () {60 vars in 1456 bytes} [Mon May 23 16:51:53 2022] DELETE /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357/os-volume_attachments/8fad954f-3792-459b-bd53-fa13fe7de3d6 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 23 16:51:53.667072 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-eb32652d-7c01-4491-90d2-eccb89cc52a3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:53.668077 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-eb32652d-7c01-4491-90d2-eccb89cc52a3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:53.675408 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-eb32652d-7c01-4491-90d2-eccb89cc52a3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:53.675859 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-eb32652d-7c01-4491-90d2-eccb89cc52a3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:53.676681 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-eb32652d-7c01-4491-90d2-eccb89cc52a3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:53.677183 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-eb32652d-7c01-4491-90d2-eccb89cc52a3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:53.717519 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-eb32652d-7c01-4491-90d2-eccb89cc52a3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054858 May 23 16:51:53.718261 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 278/583] 10.222.0.74 () {60 vars in 1342 bytes} [Mon May 23 16:51:53 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 16:51:53.768140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-efc1d4cb-24de-400a-aa06-7033996116bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:53.776799 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-efc1d4cb-24de-400a-aa06-7033996116bf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1663 microversion: 2.1 time: 0.157454 May 23 16:51:53.777789 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 306/584] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:53 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:51:53.893770 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-84ad3289-f3ab-460e-ac85-e708f7f2c63b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:53.894378 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-84ad3289-f3ab-460e-ac85-e708f7f2c63b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:53.900767 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-84ad3289-f3ab-460e-ac85-e708f7f2c63b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:53.901228 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-84ad3289-f3ab-460e-ac85-e708f7f2c63b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:53.902038 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-84ad3289-f3ab-460e-ac85-e708f7f2c63b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:53.902481 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-84ad3289-f3ab-460e-ac85-e708f7f2c63b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:54.030259 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-84ad3289-f3ab-460e-ac85-e708f7f2c63b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:54.037909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-84ad3289-f3ab-460e-ac85-e708f7f2c63b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1" status: 200 len: 1367 microversion: 2.1 time: 0.148125 May 23 16:51:54.048010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 279/585] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:53 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:51:54.729488 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-93bd2cea-ab8b-4320-ab9a-74b9e5a0e8e4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:54.730831 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-93bd2cea-ab8b-4320-ab9a-74b9e5a0e8e4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:54.733667 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=2 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:51:54.734333 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=10 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:51:54.740713 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-93bd2cea-ab8b-4320-ab9a-74b9e5a0e8e4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:54.746954 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-93bd2cea-ab8b-4320-ab9a-74b9e5a0e8e4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:54.746954 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-93bd2cea-ab8b-4320-ab9a-74b9e5a0e8e4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:54.746954 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-93bd2cea-ab8b-4320-ab9a-74b9e5a0e8e4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:54.778223 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-93bd2cea-ab8b-4320-ab9a-74b9e5a0e8e4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053427 May 23 16:51:54.779743 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 307/586] 10.222.0.74 () {60 vars in 1342 bytes} [Mon May 23 16:51:54 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 16:51:54.795497 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ae50db30-9200-49ad-9a28-b9e9a9d978f9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:54.796168 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ae50db30-9200-49ad-9a28-b9e9a9d978f9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:54.798223 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=2 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:51:54.803137 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ae50db30-9200-49ad-9a28-b9e9a9d978f9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:54.803634 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ae50db30-9200-49ad-9a28-b9e9a9d978f9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:54.804430 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ae50db30-9200-49ad-9a28-b9e9a9d978f9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:54.804864 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ae50db30-9200-49ad-9a28-b9e9a9d978f9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:54.937573 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ae50db30-9200-49ad-9a28-b9e9a9d978f9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:54.945475 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ae50db30-9200-49ad-9a28-b9e9a9d978f9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1663 microversion: 2.1 time: 0.154419 May 23 16:51:54.946130 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 280/587] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:54 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:55.055517 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-dcdcb6ac-b656-481f-881c-0adad9881e46 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:55.056135 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-dcdcb6ac-b656-481f-881c-0adad9881e46 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:55.065107 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dcdcb6ac-b656-481f-881c-0adad9881e46 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:55.065559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dcdcb6ac-b656-481f-881c-0adad9881e46 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:55.066338 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dcdcb6ac-b656-481f-881c-0adad9881e46 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:55.066784 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dcdcb6ac-b656-481f-881c-0adad9881e46 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:55.196940 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-dcdcb6ac-b656-481f-881c-0adad9881e46 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:55.205467 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-dcdcb6ac-b656-481f-881c-0adad9881e46 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1" status: 200 len: 1367 microversion: 2.1 time: 0.153892 May 23 16:51:55.206032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 308/588] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:55 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:55.791122 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-9569f679-ec5d-4912-841b-e5cf08118602 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:55.792122 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-9569f679-ec5d-4912-841b-e5cf08118602 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:55.799475 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9569f679-ec5d-4912-841b-e5cf08118602 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:55.800091 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9569f679-ec5d-4912-841b-e5cf08118602 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:55.800719 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9569f679-ec5d-4912-841b-e5cf08118602 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:55.801325 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9569f679-ec5d-4912-841b-e5cf08118602 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:55.833869 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-9569f679-ec5d-4912-841b-e5cf08118602 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047098 May 23 16:51:55.834618 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 281/589] 10.222.0.74 () {60 vars in 1342 bytes} [Mon May 23 16:51:55 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:55.901390 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7f4f8c87-5483-4dd6-85a0-d4e179119716 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:55.904696 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-7f4f8c87-5483-4dd6-85a0-d4e179119716 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:55.908594 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7f4f8c87-5483-4dd6-85a0-d4e179119716 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:55.909082 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7f4f8c87-5483-4dd6-85a0-d4e179119716 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:55.909866 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7f4f8c87-5483-4dd6-85a0-d4e179119716 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:55.910340 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7f4f8c87-5483-4dd6-85a0-d4e179119716 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:55.937426 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-7f4f8c87-5483-4dd6-85a0-d4e179119716 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Going to try to terminate instance {{(pid=124715) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 16:51:55.964431 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-fb3ec8cb-efaf-4ed8-b6d0-8b9cb738abbc tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:55.965505 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-fb3ec8cb-efaf-4ed8-b6d0-8b9cb738abbc tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:55.975103 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fb3ec8cb-efaf-4ed8-b6d0-8b9cb738abbc tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:55.975556 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fb3ec8cb-efaf-4ed8-b6d0-8b9cb738abbc tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:55.976377 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fb3ec8cb-efaf-4ed8-b6d0-8b9cb738abbc tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:55.976807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fb3ec8cb-efaf-4ed8-b6d0-8b9cb738abbc tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:56.122346 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-fb3ec8cb-efaf-4ed8-b6d0-8b9cb738abbc tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:56.130498 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-fb3ec8cb-efaf-4ed8-b6d0-8b9cb738abbc tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1667 microversion: 2.1 time: 0.171391 May 23 16:51:56.131188 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 282/590] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:55 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1667 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:51:56.267073 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-c902e82e-aa34-4513-aa76-4ba2b6d4273e req-551db1ac-ce18-4461-91c4-63de11bf7ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5df1e0c9-37f3-4752-9e82-553588ceb0b1", "name": "network-vif-plugged", "status": "completed", "tag": "f6effdfe-d86e-4a82-a12c-07ea95a8abf1"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:51:56.275885 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-c902e82e-aa34-4513-aa76-4ba2b6d4273e req-551db1ac-ce18-4461-91c4-63de11bf7ce0 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:56.281338 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-c902e82e-aa34-4513-aa76-4ba2b6d4273e req-551db1ac-ce18-4461-91c4-63de11bf7ce0 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:56.289312 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-c902e82e-aa34-4513-aa76-4ba2b6d4273e req-551db1ac-ce18-4461-91c4-63de11bf7ce0 service nova] Creating event network-vif-plugged:f6effdfe-d86e-4a82-a12c-07ea95a8abf1 for instance 5df1e0c9-37f3-4752-9e82-553588ceb0b1 on hv-cinder-83925 May 23 16:51:56.294299 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-c902e82e-aa34-4513-aa76-4ba2b6d4273e req-551db1ac-ce18-4461-91c4-63de11bf7ce0 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088678 May 23 16:51:56.295606 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 283/591] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:51:56.298613 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-7f4f8c87-5483-4dd6-85a0-d4e179119716 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "DELETE /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 204 len: 0 microversion: 2.20 time: 0.401623 May 23 16:51:56.299266 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 309/592] 10.222.0.74 () {60 vars in 1279 bytes} [Mon May 23 16:51:55 2022] DELETE /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 23 16:51:56.301103 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-db51e5a0-6639-40fe-bdc4-5eaaa16e877b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:56.302644 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-db51e5a0-6639-40fe-bdc4-5eaaa16e877b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:56.308377 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7ecc27a7-18cc-4eb6-84e8-a2a3412b2e2f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:56.309150 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-db51e5a0-6639-40fe-bdc4-5eaaa16e877b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:56.310145 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-7ecc27a7-18cc-4eb6-84e8-a2a3412b2e2f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:56.310358 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-db51e5a0-6639-40fe-bdc4-5eaaa16e877b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:56.310858 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-db51e5a0-6639-40fe-bdc4-5eaaa16e877b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:56.311453 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-db51e5a0-6639-40fe-bdc4-5eaaa16e877b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:56.315462 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7ecc27a7-18cc-4eb6-84e8-a2a3412b2e2f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:56.316205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7ecc27a7-18cc-4eb6-84e8-a2a3412b2e2f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:56.317073 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7ecc27a7-18cc-4eb6-84e8-a2a3412b2e2f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:56.317463 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7ecc27a7-18cc-4eb6-84e8-a2a3412b2e2f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:56.511450 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-db51e5a0-6639-40fe-bdc4-5eaaa16e877b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:56.516387 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-7ecc27a7-18cc-4eb6-84e8-a2a3412b2e2f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:56.526879 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-db51e5a0-6639-40fe-bdc4-5eaaa16e877b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1" status: 200 len: 1367 microversion: 2.1 time: 0.222924 May 23 16:51:56.526879 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 284/593] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:56 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:56.527101 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-7ecc27a7-18cc-4eb6-84e8-a2a3412b2e2f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:56.527101 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-7ecc27a7-18cc-4eb6-84e8-a2a3412b2e2f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:56.527316 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-7ecc27a7-18cc-4eb6-84e8-a2a3412b2e2f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1724 microversion: 2.20 time: 0.223562 May 23 16:51:56.527864 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 310/594] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:51:56 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:51:57.536654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-18eb50c3-b5d7-427d-983b-42fa67daaaee tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:57.537277 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-18eb50c3-b5d7-427d-983b-42fa67daaaee tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:57.544700 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-18eb50c3-b5d7-427d-983b-42fa67daaaee tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:57.545689 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-18eb50c3-b5d7-427d-983b-42fa67daaaee tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:57.546463 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-18eb50c3-b5d7-427d-983b-42fa67daaaee tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:57.546899 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-18eb50c3-b5d7-427d-983b-42fa67daaaee tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:57.547945 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-0cfe8f27-26a3-49f1-9357-2e4228a0c935 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:57.548644 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-0cfe8f27-26a3-49f1-9357-2e4228a0c935 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:57.555323 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0cfe8f27-26a3-49f1-9357-2e4228a0c935 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:57.555852 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0cfe8f27-26a3-49f1-9357-2e4228a0c935 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:57.556759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0cfe8f27-26a3-49f1-9357-2e4228a0c935 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:57.557283 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0cfe8f27-26a3-49f1-9357-2e4228a0c935 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:57.753343 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-18eb50c3-b5d7-427d-983b-42fa67daaaee tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:57.756432 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-0cfe8f27-26a3-49f1-9357-2e4228a0c935 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:57.760998 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-18eb50c3-b5d7-427d-983b-42fa67daaaee tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1" status: 200 len: 1367 microversion: 2.1 time: 0.228384 May 23 16:51:57.761641 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 285/595] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:57 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:57.764377 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-0cfe8f27-26a3-49f1-9357-2e4228a0c935 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:57.765911 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-0cfe8f27-26a3-49f1-9357-2e4228a0c935 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:57.767077 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-0cfe8f27-26a3-49f1-9357-2e4228a0c935 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1724 microversion: 2.20 time: 0.224062 May 23 16:51:57.767619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 311/596] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:51:57 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:51:58.778104 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-46ab738b-a0f4-4e80-a9b9-d8857fa08257 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:58.780148 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-46ab738b-a0f4-4e80-a9b9-d8857fa08257 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:58.785312 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-1f90936c-368a-451b-aa5e-839320494eb1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:58.785798 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-46ab738b-a0f4-4e80-a9b9-d8857fa08257 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:58.786166 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-1f90936c-368a-451b-aa5e-839320494eb1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:58.786307 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-46ab738b-a0f4-4e80-a9b9-d8857fa08257 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:58.786933 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-46ab738b-a0f4-4e80-a9b9-d8857fa08257 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:58.787373 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-46ab738b-a0f4-4e80-a9b9-d8857fa08257 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:58.793251 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1f90936c-368a-451b-aa5e-839320494eb1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:58.793828 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1f90936c-368a-451b-aa5e-839320494eb1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:58.795427 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1f90936c-368a-451b-aa5e-839320494eb1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:58.795893 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1f90936c-368a-451b-aa5e-839320494eb1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:58.890341 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-1f90936c-368a-451b-aa5e-839320494eb1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:58.898480 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-1f90936c-368a-451b-aa5e-839320494eb1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:58.900043 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-1f90936c-368a-451b-aa5e-839320494eb1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:58.901310 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-1f90936c-368a-451b-aa5e-839320494eb1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1657 microversion: 2.20 time: 0.119900 May 23 16:51:58.908357 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 312/597] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:51:58 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1657 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:51:58.961555 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-46ab738b-a0f4-4e80-a9b9-d8857fa08257 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:51:58.970497 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-46ab738b-a0f4-4e80-a9b9-d8857fa08257 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1" status: 200 len: 1367 microversion: 2.1 time: 0.196156 May 23 16:51:58.971084 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 286/598] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:58 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:51:58.973541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-ae7f0974-3c3d-44c4-a796-d10a80b3e577 req-991fa363-c4fc-4fbc-80af-31753eda4be1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb302c29-c30d-4ffa-af9d-1f226fd56357", "name": "network-vif-deleted", "tag": "bd409a76-162e-44c7-9e54-76b5e47accda"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:51:58.986123 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-ae7f0974-3c3d-44c4-a796-d10a80b3e577 req-991fa363-c4fc-4fbc-80af-31753eda4be1 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:58.987007 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-ae7f0974-3c3d-44c4-a796-d10a80b3e577 req-991fa363-c4fc-4fbc-80af-31753eda4be1 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:59.000256 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-ae7f0974-3c3d-44c4-a796-d10a80b3e577 req-991fa363-c4fc-4fbc-80af-31753eda4be1 service nova] Creating event network-vif-deleted:bd409a76-162e-44c7-9e54-76b5e47accda for instance bb302c29-c30d-4ffa-af9d-1f226fd56357 on hv-cinder-83925 May 23 16:51:59.005743 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-ae7f0974-3c3d-44c4-a796-d10a80b3e577 req-991fa363-c4fc-4fbc-80af-31753eda4be1 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102108 May 23 16:51:59.012501 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 313/599] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:51:59.918983 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-b1364a07-c05d-4302-a160-2c3b045af840 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:59.919746 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-b1364a07-c05d-4302-a160-2c3b045af840 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:59.934059 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b1364a07-c05d-4302-a160-2c3b045af840 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:59.934443 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b1364a07-c05d-4302-a160-2c3b045af840 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:59.935736 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b1364a07-c05d-4302-a160-2c3b045af840 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:59.936427 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b1364a07-c05d-4302-a160-2c3b045af840 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:59.967774 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b1364a07-c05d-4302-a160-2c3b045af840 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:59.968218 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b1364a07-c05d-4302-a160-2c3b045af840 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:59.968704 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.objects.instance [None req-b1364a07-c05d-4302-a160-2c3b045af840 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lazy-loading 'fault' on Instance uuid bb302c29-c30d-4ffa-af9d-1f226fd56357 {{(pid=124714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:51:59.988091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-33c8c963-9a9a-4005-986a-ee16b829bb83 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:51:59.988926 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-33c8c963-9a9a-4005-986a-ee16b829bb83 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:51:59.995151 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-33c8c963-9a9a-4005-986a-ee16b829bb83 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:59.995608 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-33c8c963-9a9a-4005-986a-ee16b829bb83 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:51:59.996413 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-33c8c963-9a9a-4005-986a-ee16b829bb83 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:51:59.996862 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-33c8c963-9a9a-4005-986a-ee16b829bb83 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:00.014992 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b1364a07-c05d-4302-a160-2c3b045af840 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:00.026170 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b1364a07-c05d-4302-a160-2c3b045af840 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:00.027908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b1364a07-c05d-4302-a160-2c3b045af840 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:00.029753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-b1364a07-c05d-4302-a160-2c3b045af840 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 200 len: 1372 microversion: 2.20 time: 0.114623 May 23 16:52:00.030621 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 287/600] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:51:59 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 1372 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:52:00.133719 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-33c8c963-9a9a-4005-986a-ee16b829bb83 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:00.141392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-33c8c963-9a9a-4005-986a-ee16b829bb83 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1" status: 200 len: 1367 microversion: 2.1 time: 0.157916 May 23 16:52:00.141965 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 314/601] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:51:59 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:52:01.047450 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-a4fb0e4f-37fe-4f1b-a920-8d9866ae4eb9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:01.048090 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-a4fb0e4f-37fe-4f1b-a920-8d9866ae4eb9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:01.050590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:01.055358 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a4fb0e4f-37fe-4f1b-a920-8d9866ae4eb9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:01.055812 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a4fb0e4f-37fe-4f1b-a920-8d9866ae4eb9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:01.056613 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a4fb0e4f-37fe-4f1b-a920-8d9866ae4eb9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:01.057053 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a4fb0e4f-37fe-4f1b-a920-8d9866ae4eb9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:01.070073 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-a4fb0e4f-37fe-4f1b-a920-8d9866ae4eb9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] HTTP exception thrown: Instance bb302c29-c30d-4ffa-af9d-1f226fd56357 could not be found. May 23 16:52:01.071666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-a4fb0e4f-37fe-4f1b-a920-8d9866ae4eb9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Request method failure captured: May 23 16:52:01.071666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 HTTP/1.1 May 23 16:52:01.071666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:52:01.071666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:52:01.071666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:52:01.071666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 16:52:01.071666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:52:01.071666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:52:01.071666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:52:01.071666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:52:01.071666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7o6m3x67e92BxzHEqdANve4dtN5kIYKdc9ZplckRWClhMNnQyV4nIhYlhri--LL7Oiteh4B5AbfZZqCbd1e5Dj38qIQq3sq8CbzuSFBdKAUuB_MzVK__CkUcKIwMshj-ggf6o1vgWHsstT_-OIHX_m8EccBvOwFOqxe88IuQT1fBNU May 23 16:52:01.071666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:52:01.071666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:52:01.071666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:52:01.071666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:52:01.071666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Openstack-Nova-Api-Version: 2.20 May 23 16:52:01.071666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:52:01.071666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:52:01.071666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: 60f9f16bd2494b7999c25509f804d794 May 23 16:52:01.071666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-122496734 May 23 16:52:01.071666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:52:01.071666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:52:01.073365 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/60f9f16bd2494b7999c25509f804d794"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/60f9f16bd2494b7999c25509f804d794"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/60f9f16bd2494b7999c25509f804d794"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_60f9f16bd2494b7999c25509f804d794"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:52:01.073365 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-AttachVolumeShelveTestJSON-122496734 May 23 16:52:01.073365 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: 60f9f16bd2494b7999c25509f804d794 May 23 16:52:01.073365 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-122496734 May 23 16:52:01.073365 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-AttachVolumeShelveTestJSON-122496734-project May 23 16:52:01.073365 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:52:01.073365 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:52:01.073365 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 29e2a2fa32cd4fb7837bdec1d83cb9da May 23 16:52:01.073365 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-AttachVolumeShelveTestJSON-122496734-project May 23 16:52:01.073365 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: > May 23 16:52:01.073365 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Instance bb302c29-c30d-4ffa-af9d-1f226fd56357 could not be found. May 23 16:52:01.073365 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': 'bb302c29-c30d-4ffa-af9d-1f226fd56357'} May 23 16:52:01.074586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:52:01.074586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:52:01.074586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:52:01.074586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:52:01.074586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:52:01.074586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:52:01.074586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:52:01.074586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:52:01.074586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:52:01.074586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:52:01.074586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb302c29-c30d-4ffa-af9d-1f226fd56357 could not be found. May 23 16:52:01.074586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:52:01.074586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:52:01.074586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:52:01.074586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:52:01.074586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:52:01.074586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:52:01.074586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:52:01.074586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:52:01.074586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:52:01.076588 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:52:01.076588 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:52:01.076588 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:52:01.076588 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:52:01.076588 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:52:01.076588 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:52:01.076588 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:52:01.076588 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb302c29-c30d-4ffa-af9d-1f226fd56357 could not be found. May 23 16:52:01.076588 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:52:01.076588 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:52:01.076588 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:52:01.076588 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:52:01.076588 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:52:01.076588 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:52:01.076588 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:52:01.076588 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:52:01.076588 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb302c29-c30d-4ffa-af9d-1f226fd56357 could not be found. May 23 16:52:01.076588 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:52:01.078043 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-a4fb0e4f-37fe-4f1b-a920-8d9866ae4eb9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Returning 404 to user: Instance bb302c29-c30d-4ffa-af9d-1f226fd56357 could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:52:01.078043 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-a4fb0e4f-37fe-4f1b-a920-8d9866ae4eb9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 404 len: 111 microversion: 2.20 time: 0.029601 May 23 16:52:01.078043 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 288/602] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:52:01 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 16:52:01.082560 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-d6e8e4b9-4ca2-4248-af29-cfc483cac495 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '.version_select at 0x7f224c3afaf0>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:01.156578 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-d6e8e4b9-4ca2-4248-af29-cfc483cac495 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1384241542" status: 204 len: 0 microversion: 2.20 time: 0.077718 May 23 16:52:01.157166 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 315/603] 10.222.0.74 () {60 vars in 1261 bytes} [Mon May 23 16:52:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1384241542 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 16:52:01.160049 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-19c0b2d8-62b4-45a2-9ba6-2cb0a9f904ac tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:01.161455 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-19c0b2d8-62b4-45a2-9ba6-2cb0a9f904ac tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:01.168284 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-19c0b2d8-62b4-45a2-9ba6-2cb0a9f904ac tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:01.168765 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-19c0b2d8-62b4-45a2-9ba6-2cb0a9f904ac tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:01.169586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-19c0b2d8-62b4-45a2-9ba6-2cb0a9f904ac tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:01.170032 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-19c0b2d8-62b4-45a2-9ba6-2cb0a9f904ac tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:01.350806 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-19c0b2d8-62b4-45a2-9ba6-2cb0a9f904ac tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:01.358175 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-19c0b2d8-62b4-45a2-9ba6-2cb0a9f904ac tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1" status: 200 len: 1557 microversion: 2.1 time: 0.202716 May 23 16:52:01.358736 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 289/604] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:01 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 => generated 1557 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:52:01.375065 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e1bfa042-c442-4a45-8e37-635aa435b840 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:01.377421 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e1bfa042-c442-4a45-8e37-635aa435b840 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:01.381632 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e1bfa042-c442-4a45-8e37-635aa435b840 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:01.382085 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e1bfa042-c442-4a45-8e37-635aa435b840 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:01.382848 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e1bfa042-c442-4a45-8e37-635aa435b840 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:01.383287 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e1bfa042-c442-4a45-8e37-635aa435b840 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:01.486684 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e1bfa042-c442-4a45-8e37-635aa435b840 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116145 May 23 16:52:01.487395 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 316/605] 10.222.0.74 () {58 vars in 1274 bytes} [Mon May 23 16:52:01 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:52:02.024418 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-67ad7102-3078-48d7-b505-0246121e2601 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Action: 'create', calling method: .version_select at 0x7f224c5163a0>, body: {"keypair": {"name": "tempest-keypair-395537274", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOBNHSzL1VF/l0CMWRzE79FaHkDLQxTp95B4GxfgaZ+TsInEbV/H+pj/yukN0+ae5jWoEBtS5pesSc/EenOnupgCP5osuDlT6tevJzeRk3RVf7/dJrsmSf8QlVM1Nbwlg=="}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:52:02.038535 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-67ad7102-3078-48d7-b505-0246121e2601 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Getting quotas for project 60f9f16bd2494b7999c25509f804d794. Resources: {'key_pairs'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:52:02.042323 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-67ad7102-3078-48d7-b505-0246121e2601 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Getting quotas for user 29e2a2fa32cd4fb7837bdec1d83cb9da and project 60f9f16bd2494b7999c25509f804d794. Resources: {'key_pairs'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:52:02.121370 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-67ad7102-3078-48d7-b505-0246121e2601 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.101086 May 23 16:52:02.122116 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 290/606] 10.222.0.74 () {62 vars in 1199 bytes} [Mon May 23 16:52:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 102 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 23 16:52:02.476451 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-285e4b85-c072-42d4-9dc9-f1b07a7ca105 req-7247ef49-c229-42e3-9191-db009ab343a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5df1e0c9-37f3-4752-9e82-553588ceb0b1", "tag": "f6effdfe-d86e-4a82-a12c-07ea95a8abf1"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:52:02.484981 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-285e4b85-c072-42d4-9dc9-f1b07a7ca105 req-7247ef49-c229-42e3-9191-db009ab343a7 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:02.485422 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-285e4b85-c072-42d4-9dc9-f1b07a7ca105 req-7247ef49-c229-42e3-9191-db009ab343a7 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:02.496066 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-285e4b85-c072-42d4-9dc9-f1b07a7ca105 req-7247ef49-c229-42e3-9191-db009ab343a7 service nova] Creating event network-changed:f6effdfe-d86e-4a82-a12c-07ea95a8abf1 for instance 5df1e0c9-37f3-4752-9e82-553588ceb0b1 on hv-cinder-83925 May 23 16:52:02.501651 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-285e4b85-c072-42d4-9dc9-f1b07a7ca105 req-7247ef49-c229-42e3-9191-db009ab343a7 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029645 May 23 16:52:02.502259 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 317/607] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:52:04.257317 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-012ec7e7-c901-46e2-ba91-3d44f08ce0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-716157499", "imageRef": "96972e76-879d-4149-a713-a94529892aad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c44bb036-b813-45bb-9b92-4ac7d7ecd450"}], "security_groups": [{"name": "tempest-securitygroup--305859362"}], "key_name": "tempest-keypair-395537274", "user_data": "}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:52:04.358682 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.network.neutron [None req-012ec7e7-c901-46e2-ba91-3d44f08ce0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] validate_networks() for [('c44bb036-b813-45bb-9b92-4ac7d7ecd450', None, None, None, None, None)] {{(pid=124714) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 16:52:04.759831 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-012ec7e7-c901-46e2-ba91-3d44f08ce0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Flavor limits 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 16:52:04.760261 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-012ec7e7-c901-46e2-ba91-3d44f08ce0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Image limits 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 16:52:04.760782 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-012ec7e7-c901-46e2-ba91-3d44f08ce0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Flavor pref 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 16:52:04.761195 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-012ec7e7-c901-46e2-ba91-3d44f08ce0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Image pref 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 16:52:04.761609 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-012ec7e7-c901-46e2-ba91-3d44f08ce0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 16:52:04.770442 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-012ec7e7-c901-46e2-ba91-3d44f08ce0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:04.770884 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-012ec7e7-c901-46e2-ba91-3d44f08ce0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:04.771672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-012ec7e7-c901-46e2-ba91-3d44f08ce0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:04.772107 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-012ec7e7-c901-46e2-ba91-3d44f08ce0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:04.788895 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-012ec7e7-c901-46e2-ba91-3d44f08ce0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Getting quotas for project 60f9f16bd2494b7999c25509f804d794. Resources: {'cores', 'instances', 'ram'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:52:04.792841 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-012ec7e7-c901-46e2-ba91-3d44f08ce0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Getting quotas for user 29e2a2fa32cd4fb7837bdec1d83cb9da and project 60f9f16bd2494b7999c25509f804d794. Resources: {'cores', 'instances', 'ram'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:52:04.804441 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-012ec7e7-c901-46e2-ba91-3d44f08ce0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Going to run 1 instances... {{(pid=124714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 16:52:04.806714 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-012ec7e7-c901-46e2-ba91-3d44f08ce0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96972e76-879d-4149-a713-a94529892aad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 16:52:04.961909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-012ec7e7-c901-46e2-ba91-3d44f08ce0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.708897 May 23 16:52:04.962473 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 291/608] 10.222.0.74 () {62 vars in 1187 bytes} [Mon May 23 16:52:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 23 16:52:04.973912 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-69a8b342-5124-4c69-b3b0-964b20ab545b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:04.974952 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-69a8b342-5124-4c69-b3b0-964b20ab545b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:05.030985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-69a8b342-5124-4c69-b3b0-964b20ab545b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:05.038840 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-69a8b342-5124-4c69-b3b0-964b20ab545b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:05.041113 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-69a8b342-5124-4c69-b3b0-964b20ab545b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:05.042267 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-69a8b342-5124-4c69-b3b0-964b20ab545b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1280 microversion: 2.20 time: 0.073309 May 23 16:52:05.042779 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 318/609] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:52:04 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:52:05.522826 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-3cc82d28-284c-449e-9f93-f70070a38f49 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:05.523368 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-3cc82d28-284c-449e-9f93-f70070a38f49 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:05.530774 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3cc82d28-284c-449e-9f93-f70070a38f49 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:05.531227 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3cc82d28-284c-449e-9f93-f70070a38f49 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:05.532337 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3cc82d28-284c-449e-9f93-f70070a38f49 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:05.532454 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3cc82d28-284c-449e-9f93-f70070a38f49 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:05.614548 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.objects.instance [None req-3cc82d28-284c-449e-9f93-f70070a38f49 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lazy-loading 'services' on Instance uuid 14a3c1df-8e11-4485-a5ef-fa843b4362d3 {{(pid=124714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:52:05.811152 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-3cc82d28-284c-449e-9f93-f70070a38f49 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "DELETE /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3/os-volume_attachments/7a7175af-a87b-4f6b-9e72-c87940ef51a9" status: 202 len: 0 microversion: 2.1 time: 0.292555 May 23 16:52:05.811752 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 292/610] 10.222.0.74 () {58 vars in 1415 bytes} [Mon May 23 16:52:05 2022] DELETE /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3/os-volume_attachments/7a7175af-a87b-4f6b-9e72-c87940ef51a9 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:52:05.819981 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-123d6989-b69c-4713-adf7-0c17886ce3ad tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:05.820975 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-123d6989-b69c-4713-adf7-0c17886ce3ad tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:05.827928 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-123d6989-b69c-4713-adf7-0c17886ce3ad tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:05.828400 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-123d6989-b69c-4713-adf7-0c17886ce3ad tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:05.829173 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-123d6989-b69c-4713-adf7-0c17886ce3ad tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:05.829616 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-123d6989-b69c-4713-adf7-0c17886ce3ad tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:05.859721 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-123d6989-b69c-4713-adf7-0c17886ce3ad tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043662 May 23 16:52:05.860287 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 319/611] 10.222.0.74 () {58 vars in 1301 bytes} [Mon May 23 16:52:05 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:52:06.061009 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-55457aea-2521-4ced-977e-8def4a9061f2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:06.061734 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-55457aea-2521-4ced-977e-8def4a9061f2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:06.067914 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-55457aea-2521-4ced-977e-8def4a9061f2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:06.070998 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-55457aea-2521-4ced-977e-8def4a9061f2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:06.070998 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-55457aea-2521-4ced-977e-8def4a9061f2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:06.070998 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-55457aea-2521-4ced-977e-8def4a9061f2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:06.073508 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:06.130080 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-55457aea-2521-4ced-977e-8def4a9061f2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:06.139160 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-55457aea-2521-4ced-977e-8def4a9061f2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:06.140777 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-55457aea-2521-4ced-977e-8def4a9061f2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:06.141879 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-55457aea-2521-4ced-977e-8def4a9061f2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1284 microversion: 2.20 time: 0.085201 May 23 16:52:06.142437 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 293/612] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:52:06 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:52:06.872762 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-02308cc7-3218-4c6d-a71d-987a6f705cff tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:06.874549 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-02308cc7-3218-4c6d-a71d-987a6f705cff tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:06.881053 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-02308cc7-3218-4c6d-a71d-987a6f705cff tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:06.881512 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-02308cc7-3218-4c6d-a71d-987a6f705cff tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:06.882288 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-02308cc7-3218-4c6d-a71d-987a6f705cff tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:06.882790 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-02308cc7-3218-4c6d-a71d-987a6f705cff tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:06.911734 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-02308cc7-3218-4c6d-a71d-987a6f705cff tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043236 May 23 16:52:06.912707 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 320/613] 10.222.0.74 () {58 vars in 1301 bytes} [Mon May 23 16:52:06 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:52:07.159910 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-c973d202-33c2-48ff-b437-3acc57ca6f9a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:07.160483 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-c973d202-33c2-48ff-b437-3acc57ca6f9a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:07.167499 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c973d202-33c2-48ff-b437-3acc57ca6f9a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:07.167952 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c973d202-33c2-48ff-b437-3acc57ca6f9a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:07.168751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c973d202-33c2-48ff-b437-3acc57ca6f9a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:07.169256 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c973d202-33c2-48ff-b437-3acc57ca6f9a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:07.242071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-c973d202-33c2-48ff-b437-3acc57ca6f9a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:07.253432 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-c973d202-33c2-48ff-b437-3acc57ca6f9a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:07.255133 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-c973d202-33c2-48ff-b437-3acc57ca6f9a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:07.256257 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-c973d202-33c2-48ff-b437-3acc57ca6f9a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1340 microversion: 2.20 time: 0.100360 May 23 16:52:07.257235 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 294/614] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:52:07 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1340 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:52:07.926425 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c3b05614-72e0-413e-8166-be8d502be5dd tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:07.927478 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-c3b05614-72e0-413e-8166-be8d502be5dd tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:07.936128 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c3b05614-72e0-413e-8166-be8d502be5dd tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:07.936128 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c3b05614-72e0-413e-8166-be8d502be5dd tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:07.936870 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c3b05614-72e0-413e-8166-be8d502be5dd tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:07.937409 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c3b05614-72e0-413e-8166-be8d502be5dd tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:07.974800 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-c3b05614-72e0-413e-8166-be8d502be5dd tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055174 May 23 16:52:07.975600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 321/615] 10.222.0.74 () {58 vars in 1301 bytes} [Mon May 23 16:52:07 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 16:52:08.057445 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-685966c9-2fcf-4078-81ea-91712a4131ab tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:08.057951 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-685966c9-2fcf-4078-81ea-91712a4131ab tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:08.064390 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-685966c9-2fcf-4078-81ea-91712a4131ab tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:08.064841 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-685966c9-2fcf-4078-81ea-91712a4131ab tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:08.065604 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-685966c9-2fcf-4078-81ea-91712a4131ab tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:08.066088 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-685966c9-2fcf-4078-81ea-91712a4131ab tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:08.090557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-685966c9-2fcf-4078-81ea-91712a4131ab tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Going to try to terminate instance {{(pid=124714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 16:52:08.276061 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-f7bfe3ee-5234-4f9a-ba62-a406f834d886 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:08.276061 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-f7bfe3ee-5234-4f9a-ba62-a406f834d886 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:08.282931 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f7bfe3ee-5234-4f9a-ba62-a406f834d886 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:08.283460 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f7bfe3ee-5234-4f9a-ba62-a406f834d886 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:08.284359 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f7bfe3ee-5234-4f9a-ba62-a406f834d886 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:08.284885 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f7bfe3ee-5234-4f9a-ba62-a406f834d886 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:08.406609 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-685966c9-2fcf-4078-81ea-91712a4131ab tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "DELETE /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 204 len: 0 microversion: 2.1 time: 0.352819 May 23 16:52:08.410405 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 295/616] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 16:52:08 2022] DELETE /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 16:52:08.415915 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-3785f950-880d-4239-b117-3bf692be3576 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:08.417033 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-3785f950-880d-4239-b117-3bf692be3576 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:08.425382 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3785f950-880d-4239-b117-3bf692be3576 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:08.426044 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3785f950-880d-4239-b117-3bf692be3576 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:08.427039 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3785f950-880d-4239-b117-3bf692be3576 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:08.428380 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f7bfe3ee-5234-4f9a-ba62-a406f834d886 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:08.428930 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3785f950-880d-4239-b117-3bf692be3576 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:08.440705 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f7bfe3ee-5234-4f9a-ba62-a406f834d886 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:08.442490 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f7bfe3ee-5234-4f9a-ba62-a406f834d886 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:08.454640 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-f7bfe3ee-5234-4f9a-ba62-a406f834d886 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1405 microversion: 2.20 time: 0.172623 May 23 16:52:08.454640 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 322/617] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:52:08 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:52:08.565801 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-3785f950-880d-4239-b117-3bf692be3576 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:08.573019 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-3785f950-880d-4239-b117-3bf692be3576 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1689 microversion: 2.1 time: 0.161412 May 23 16:52:08.574528 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 296/618] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:08 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:52:09.175362 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-17ede76d-3796-4e6e-804f-a0b23d65e110 req-0e1a2e62-103e-443c-993d-e82570438035 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa18b171-8b37-4fcc-b7e9-e50494e967af", "tag": "7fc3fb4c-c736-453c-a8e0-bd34a6233442"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:52:09.184346 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-17ede76d-3796-4e6e-804f-a0b23d65e110 req-0e1a2e62-103e-443c-993d-e82570438035 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:09.184789 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-17ede76d-3796-4e6e-804f-a0b23d65e110 req-0e1a2e62-103e-443c-993d-e82570438035 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:09.197464 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-17ede76d-3796-4e6e-804f-a0b23d65e110 req-0e1a2e62-103e-443c-993d-e82570438035 service nova] Creating event network-changed:7fc3fb4c-c736-453c-a8e0-bd34a6233442 for instance fa18b171-8b37-4fcc-b7e9-e50494e967af on hv-cinder-83925 May 23 16:52:09.203197 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-17ede76d-3796-4e6e-804f-a0b23d65e110 req-0e1a2e62-103e-443c-993d-e82570438035 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033239 May 23 16:52:09.203891 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 323/619] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:52:09.462543 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-fc9a0a35-94e9-4d65-99c6-85ab55c186f4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:09.463098 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-fc9a0a35-94e9-4d65-99c6-85ab55c186f4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:09.469576 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fc9a0a35-94e9-4d65-99c6-85ab55c186f4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:09.470027 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fc9a0a35-94e9-4d65-99c6-85ab55c186f4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:09.470825 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fc9a0a35-94e9-4d65-99c6-85ab55c186f4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:09.471267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fc9a0a35-94e9-4d65-99c6-85ab55c186f4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:09.592237 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-240d5d70-5b73-4f21-a1fc-e406d538c947 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:09.600049 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-240d5d70-5b73-4f21-a1fc-e406d538c947 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:09.602134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-fc9a0a35-94e9-4d65-99c6-85ab55c186f4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:09.606494 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-240d5d70-5b73-4f21-a1fc-e406d538c947 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:09.606986 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-240d5d70-5b73-4f21-a1fc-e406d538c947 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:09.608416 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-240d5d70-5b73-4f21-a1fc-e406d538c947 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:09.608961 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-240d5d70-5b73-4f21-a1fc-e406d538c947 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:09.611135 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-fc9a0a35-94e9-4d65-99c6-85ab55c186f4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:09.612772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-fc9a0a35-94e9-4d65-99c6-85ab55c186f4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:09.613953 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-fc9a0a35-94e9-4d65-99c6-85ab55c186f4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1405 microversion: 2.20 time: 0.155691 May 23 16:52:09.614595 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 297/620] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:52:09 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:52:09.735944 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-240d5d70-5b73-4f21-a1fc-e406d538c947 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:09.743525 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-240d5d70-5b73-4f21-a1fc-e406d538c947 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1689 microversion: 2.1 time: 0.156348 May 23 16:52:09.744095 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 324/621] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:09 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:52:10.631668 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-25258ec8-105c-4ee4-bd29-6731449184f3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:10.632284 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-25258ec8-105c-4ee4-bd29-6731449184f3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:10.639271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-25258ec8-105c-4ee4-bd29-6731449184f3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:10.639726 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-25258ec8-105c-4ee4-bd29-6731449184f3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:10.640517 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-25258ec8-105c-4ee4-bd29-6731449184f3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:10.640995 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-25258ec8-105c-4ee4-bd29-6731449184f3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:10.760911 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-f7fac0b8-7a48-4065-af70-e84121bad421 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:10.761445 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-f7fac0b8-7a48-4065-af70-e84121bad421 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:10.768444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f7fac0b8-7a48-4065-af70-e84121bad421 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:10.768909 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f7fac0b8-7a48-4065-af70-e84121bad421 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:10.769763 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f7fac0b8-7a48-4065-af70-e84121bad421 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:10.770214 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f7fac0b8-7a48-4065-af70-e84121bad421 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:10.771254 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-25258ec8-105c-4ee4-bd29-6731449184f3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:10.779854 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-25258ec8-105c-4ee4-bd29-6731449184f3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:10.781378 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-25258ec8-105c-4ee4-bd29-6731449184f3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:10.782570 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-25258ec8-105c-4ee4-bd29-6731449184f3 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1405 microversion: 2.20 time: 0.154899 May 23 16:52:10.783128 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 298/622] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:52:10 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:52:10.899728 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f7fac0b8-7a48-4065-af70-e84121bad421 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:10.903260 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:10.908157 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-f7fac0b8-7a48-4065-af70-e84121bad421 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1689 microversion: 2.1 time: 0.151715 May 23 16:52:10.913723 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 325/623] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:10 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:52:11.801400 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-239488e0-5fca-4031-96d3-6fb1e78591cc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:11.802080 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-239488e0-5fca-4031-96d3-6fb1e78591cc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:11.808622 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-239488e0-5fca-4031-96d3-6fb1e78591cc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:11.809077 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-239488e0-5fca-4031-96d3-6fb1e78591cc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:11.809852 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-239488e0-5fca-4031-96d3-6fb1e78591cc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:11.810382 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-239488e0-5fca-4031-96d3-6fb1e78591cc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:11.927041 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-3d41c29e-bbae-4de7-89e3-0799ab2b5991 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:11.927749 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-3d41c29e-bbae-4de7-89e3-0799ab2b5991 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:11.934818 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3d41c29e-bbae-4de7-89e3-0799ab2b5991 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:11.935370 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3d41c29e-bbae-4de7-89e3-0799ab2b5991 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:11.936677 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3d41c29e-bbae-4de7-89e3-0799ab2b5991 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:11.937179 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3d41c29e-bbae-4de7-89e3-0799ab2b5991 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:11.943715 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-239488e0-5fca-4031-96d3-6fb1e78591cc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:11.952256 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-239488e0-5fca-4031-96d3-6fb1e78591cc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:11.954156 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-239488e0-5fca-4031-96d3-6fb1e78591cc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:11.955397 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-239488e0-5fca-4031-96d3-6fb1e78591cc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1405 microversion: 2.20 time: 0.157964 May 23 16:52:11.956358 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 299/624] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:52:11 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:52:12.079323 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-3d41c29e-bbae-4de7-89e3-0799ab2b5991 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:12.087227 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-3d41c29e-bbae-4de7-89e3-0799ab2b5991 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1689 microversion: 2.1 time: 0.165250 May 23 16:52:12.087790 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 326/625] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:11 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:52:12.973471 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-fd53b37c-5f50-4cf4-912a-381902edadd8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:12.974095 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-fd53b37c-5f50-4cf4-912a-381902edadd8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:12.980679 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fd53b37c-5f50-4cf4-912a-381902edadd8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:12.981139 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fd53b37c-5f50-4cf4-912a-381902edadd8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:12.981914 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fd53b37c-5f50-4cf4-912a-381902edadd8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:12.982854 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fd53b37c-5f50-4cf4-912a-381902edadd8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:13.061798 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-6627c569-7088-474a-adb1-91b7bae86e7a req-2aaf196c-3d0e-43d8-b35f-32db6974149f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a3c1df-8e11-4485-a5ef-fa843b4362d3", "name": "network-vif-deleted", "tag": "e00c55e6-6b89-4971-bceb-0a87e0ee6987"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:52:13.069891 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-6627c569-7088-474a-adb1-91b7bae86e7a req-2aaf196c-3d0e-43d8-b35f-32db6974149f service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:13.070533 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-6627c569-7088-474a-adb1-91b7bae86e7a req-2aaf196c-3d0e-43d8-b35f-32db6974149f service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:13.083392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-6627c569-7088-474a-adb1-91b7bae86e7a req-2aaf196c-3d0e-43d8-b35f-32db6974149f service nova] Creating event network-vif-deleted:e00c55e6-6b89-4971-bceb-0a87e0ee6987 for instance 14a3c1df-8e11-4485-a5ef-fa843b4362d3 on hv-cinder-83925 May 23 16:52:13.089271 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-6627c569-7088-474a-adb1-91b7bae86e7a req-2aaf196c-3d0e-43d8-b35f-32db6974149f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033158 May 23 16:52:13.095106 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 327/626] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:52:13.110456 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-824ffb00-6293-4baf-b31c-e36d747ad0c3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:13.111464 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-824ffb00-6293-4baf-b31c-e36d747ad0c3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:13.118632 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-824ffb00-6293-4baf-b31c-e36d747ad0c3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:13.119629 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-824ffb00-6293-4baf-b31c-e36d747ad0c3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:13.120838 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-824ffb00-6293-4baf-b31c-e36d747ad0c3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:13.121365 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-824ffb00-6293-4baf-b31c-e36d747ad0c3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:13.127068 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-fd53b37c-5f50-4cf4-912a-381902edadd8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:13.134926 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-fd53b37c-5f50-4cf4-912a-381902edadd8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:13.136482 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-fd53b37c-5f50-4cf4-912a-381902edadd8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:13.138045 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-fd53b37c-5f50-4cf4-912a-381902edadd8 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1405 microversion: 2.20 time: 0.168526 May 23 16:52:13.138756 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 300/627] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:52:12 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:52:13.198399 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-824ffb00-6293-4baf-b31c-e36d747ad0c3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:13.207689 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-824ffb00-6293-4baf-b31c-e36d747ad0c3 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1622 microversion: 2.1 time: 0.106083 May 23 16:52:13.208504 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 328/628] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:13 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1622 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:52:14.157027 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-cabb7d79-f242-4ad9-a800-3704a6e023d5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:14.157652 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-cabb7d79-f242-4ad9-a800-3704a6e023d5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:14.164110 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cabb7d79-f242-4ad9-a800-3704a6e023d5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:14.164591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cabb7d79-f242-4ad9-a800-3704a6e023d5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:14.165350 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cabb7d79-f242-4ad9-a800-3704a6e023d5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:14.165782 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cabb7d79-f242-4ad9-a800-3704a6e023d5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:14.226440 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-aa4cdac4-c224-4aee-b80d-f656d4230ec0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:14.227083 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-aa4cdac4-c224-4aee-b80d-f656d4230ec0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:14.234372 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-aa4cdac4-c224-4aee-b80d-f656d4230ec0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:14.234679 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-aa4cdac4-c224-4aee-b80d-f656d4230ec0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:14.235458 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-aa4cdac4-c224-4aee-b80d-f656d4230ec0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:14.235897 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-aa4cdac4-c224-4aee-b80d-f656d4230ec0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:14.312551 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-aa4cdac4-c224-4aee-b80d-f656d4230ec0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:14.316972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-cabb7d79-f242-4ad9-a800-3704a6e023d5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:14.320047 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-aa4cdac4-c224-4aee-b80d-f656d4230ec0 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1622 microversion: 2.1 time: 0.097501 May 23 16:52:14.320657 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 329/629] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:14 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1622 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:52:14.325217 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-cabb7d79-f242-4ad9-a800-3704a6e023d5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:14.326857 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-cabb7d79-f242-4ad9-a800-3704a6e023d5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:14.328042 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-cabb7d79-f242-4ad9-a800-3704a6e023d5 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1405 microversion: 2.20 time: 0.175521 May 23 16:52:14.328706 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 301/630] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:52:14 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:52:15.337147 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-30e30f2b-abae-4f0a-99ea-dd1be80a494c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:15.337705 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-30e30f2b-abae-4f0a-99ea-dd1be80a494c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:15.339668 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=2 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:15.343861 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=2 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:15.344653 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=10 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:15.345671 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30e30f2b-abae-4f0a-99ea-dd1be80a494c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:15.346121 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30e30f2b-abae-4f0a-99ea-dd1be80a494c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:15.346940 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30e30f2b-abae-4f0a-99ea-dd1be80a494c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:15.347379 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30e30f2b-abae-4f0a-99ea-dd1be80a494c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:15.349100 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-d4f08fcc-e9e8-4136-aa67-3a1e0b7c9860 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:15.349710 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-d4f08fcc-e9e8-4136-aa67-3a1e0b7c9860 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:15.355721 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d4f08fcc-e9e8-4136-aa67-3a1e0b7c9860 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:15.356170 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d4f08fcc-e9e8-4136-aa67-3a1e0b7c9860 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:15.356966 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d4f08fcc-e9e8-4136-aa67-3a1e0b7c9860 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:15.357455 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d4f08fcc-e9e8-4136-aa67-3a1e0b7c9860 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:15.385131 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30e30f2b-abae-4f0a-99ea-dd1be80a494c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:15.385586 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30e30f2b-abae-4f0a-99ea-dd1be80a494c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:15.386035 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.objects.instance [None req-30e30f2b-abae-4f0a-99ea-dd1be80a494c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lazy-loading 'fault' on Instance uuid 14a3c1df-8e11-4485-a5ef-fa843b4362d3 {{(pid=124715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:52:15.455489 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-30e30f2b-abae-4f0a-99ea-dd1be80a494c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:15.463100 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-30e30f2b-abae-4f0a-99ea-dd1be80a494c tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 200 len: 1336 microversion: 2.1 time: 0.130116 May 23 16:52:15.463666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 330/631] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:15 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 1336 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:52:15.518373 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-d4f08fcc-e9e8-4136-aa67-3a1e0b7c9860 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:15.526317 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-d4f08fcc-e9e8-4136-aa67-3a1e0b7c9860 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:15.527831 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-d4f08fcc-e9e8-4136-aa67-3a1e0b7c9860 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:15.529029 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-d4f08fcc-e9e8-4136-aa67-3a1e0b7c9860 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1405 microversion: 2.20 time: 0.186056 May 23 16:52:15.530266 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 302/632] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:52:15 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:52:16.480842 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-390d3a52-d031-4101-b842-81409cfd9bce tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:16.481452 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-390d3a52-d031-4101-b842-81409cfd9bce tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 14a3c1df-8e11-4485-a5ef-fa843b4362d3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:16.488717 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-390d3a52-d031-4101-b842-81409cfd9bce tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:16.489162 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-390d3a52-d031-4101-b842-81409cfd9bce tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:16.489922 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-390d3a52-d031-4101-b842-81409cfd9bce tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:16.490357 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-390d3a52-d031-4101-b842-81409cfd9bce tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:16.503864 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-390d3a52-d031-4101-b842-81409cfd9bce tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] HTTP exception thrown: Instance 14a3c1df-8e11-4485-a5ef-fa843b4362d3 could not be found. May 23 16:52:16.507737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-390d3a52-d031-4101-b842-81409cfd9bce tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Request method failure captured: May 23 16:52:16.507737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 HTTP/1.1 May 23 16:52:16.507737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:52:16.507737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:52:16.507737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:52:16.507737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:52:16.507737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:52:16.507737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:52:16.507737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:52:16.507737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:52:16.507737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7o2WukSo8MVh2vnrT0Gb8xsUoVX_gA4ZRtYP_ktCPbSO2DDauFM_C7u7kWk3VGOZRNEQJWCkkdSQViJZ1u-fzhESfTWj231c6MIBn8Mmt4wfYftDRBPMAgBmDWUt7URCKm3USy34i6WhHz3kcqn7lqeWxjid60wtGzqVjLxfEi2w6I May 23 16:52:16.507737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:52:16.507737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:52:16.507737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:52:16.507737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:52:16.507737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:52:16.507737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:52:16.507737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: 8c4eba5d39e545cbb8380490c86045f0 May 23 16:52:16.507737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-8767631 May 23 16:52:16.507737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:52:16.507737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:52:16.509319 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8c4eba5d39e545cbb8380490c86045f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8c4eba5d39e545cbb8380490c86045f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8c4eba5d39e545cbb8380490c86045f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8c4eba5d39e545cbb8380490c86045f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:52:16.509319 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-ServerRescueNegativeTestJSON-8767631 May 23 16:52:16.509319 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: 8c4eba5d39e545cbb8380490c86045f0 May 23 16:52:16.509319 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-8767631 May 23 16:52:16.509319 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-ServerRescueNegativeTestJSON-8767631-project May 23 16:52:16.509319 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:52:16.509319 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:52:16.509319 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: f14f77bc65fd4ff0bc1ec6de35846f14 May 23 16:52:16.509319 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-ServerRescueNegativeTestJSON-8767631-project May 23 16:52:16.509319 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 16:52:16.509319 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Instance 14a3c1df-8e11-4485-a5ef-fa843b4362d3 could not be found. May 23 16:52:16.509319 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': '14a3c1df-8e11-4485-a5ef-fa843b4362d3'} May 23 16:52:16.510091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:52:16.510091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:52:16.510091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:52:16.510091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:52:16.510091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:52:16.510091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:52:16.510091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:52:16.510091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:52:16.510091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:52:16.510091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:52:16.510091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14a3c1df-8e11-4485-a5ef-fa843b4362d3 could not be found. May 23 16:52:16.510091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:52:16.510091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:52:16.510091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:52:16.510091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:52:16.510091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:52:16.510091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:52:16.510091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:52:16.510091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:52:16.510091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:52:16.511313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:52:16.511313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:52:16.511313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:52:16.511313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:52:16.511313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:52:16.511313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:52:16.511313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:52:16.511313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14a3c1df-8e11-4485-a5ef-fa843b4362d3 could not be found. May 23 16:52:16.511313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:52:16.511313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:52:16.511313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:52:16.511313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:52:16.511313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:52:16.511313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:52:16.511313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:52:16.511313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:52:16.511313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14a3c1df-8e11-4485-a5ef-fa843b4362d3 could not be found. May 23 16:52:16.511313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:52:16.512958 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-390d3a52-d031-4101-b842-81409cfd9bce tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Returning 404 to user: Instance 14a3c1df-8e11-4485-a5ef-fa843b4362d3 could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:52:16.512958 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-390d3a52-d031-4101-b842-81409cfd9bce tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3" status: 404 len: 111 microversion: 2.1 time: 0.029969 May 23 16:52:16.512958 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 331/633] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:16 2022] GET /compute/v2.1/servers/14a3c1df-8e11-4485-a5ef-fa843b4362d3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:52:16.516078 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-b8bd41bf-0a2b-4cf0-81ab-50a1a38f359a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '.version_select at 0x7f224c31f430>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:16.549340 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-2e68876f-5736-4c61-bedb-4bd29e24dbdd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:16.550151 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-2e68876f-5736-4c61-bedb-4bd29e24dbdd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:16.556290 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2e68876f-5736-4c61-bedb-4bd29e24dbdd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:16.556774 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2e68876f-5736-4c61-bedb-4bd29e24dbdd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:16.557590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2e68876f-5736-4c61-bedb-4bd29e24dbdd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:16.558015 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2e68876f-5736-4c61-bedb-4bd29e24dbdd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:16.641939 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-b8bd41bf-0a2b-4cf0-81ab-50a1a38f359a tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1608691226" status: 202 len: 0 microversion: 2.1 time: 0.129960 May 23 16:52:16.642579 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 303/634] 10.222.0.74 () {58 vars in 1220 bytes} [Mon May 23 16:52:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1608691226 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 16:52:16.690186 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-2e68876f-5736-4c61-bedb-4bd29e24dbdd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:16.698250 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-2e68876f-5736-4c61-bedb-4bd29e24dbdd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:16.699769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-2e68876f-5736-4c61-bedb-4bd29e24dbdd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:16.701415 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-2e68876f-5736-4c61-bedb-4bd29e24dbdd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1405 microversion: 2.20 time: 0.156348 May 23 16:52:16.702676 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 332/635] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:52:16 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:52:17.720607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-978e1473-5332-4483-851e-46044db095ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:17.721186 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-978e1473-5332-4483-851e-46044db095ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:17.727089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-978e1473-5332-4483-851e-46044db095ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:17.727535 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-978e1473-5332-4483-851e-46044db095ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:17.728288 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-978e1473-5332-4483-851e-46044db095ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:17.728747 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-978e1473-5332-4483-851e-46044db095ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:17.864036 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-978e1473-5332-4483-851e-46044db095ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:17.871829 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-978e1473-5332-4483-851e-46044db095ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:17.873682 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-978e1473-5332-4483-851e-46044db095ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:17.874772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-978e1473-5332-4483-851e-46044db095ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1405 microversion: 2.20 time: 0.158716 May 23 16:52:17.875320 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 304/636] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:52:17 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:52:18.283613 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-b7302814-e142-4b57-8490-40df4737feee req-27850720-3f96-47ce-9efd-da9edb275c02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa18b171-8b37-4fcc-b7e9-e50494e967af", "name": "network-vif-plugged", "status": "completed", "tag": "7fc3fb4c-c736-453c-a8e0-bd34a6233442"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:52:18.292343 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-b7302814-e142-4b57-8490-40df4737feee req-27850720-3f96-47ce-9efd-da9edb275c02 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:18.292827 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-b7302814-e142-4b57-8490-40df4737feee req-27850720-3f96-47ce-9efd-da9edb275c02 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:18.304714 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-b7302814-e142-4b57-8490-40df4737feee req-27850720-3f96-47ce-9efd-da9edb275c02 service nova] Creating event network-vif-plugged:7fc3fb4c-c736-453c-a8e0-bd34a6233442 for instance fa18b171-8b37-4fcc-b7e9-e50494e967af on hv-cinder-83925 May 23 16:52:18.314058 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-b7302814-e142-4b57-8490-40df4737feee req-27850720-3f96-47ce-9efd-da9edb275c02 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029647 May 23 16:52:18.314058 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 333/637] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:52:18.893654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-7bfe3a61-45bb-453d-bcf0-39a923abe108 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:18.894271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-7bfe3a61-45bb-453d-bcf0-39a923abe108 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:18.901013 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7bfe3a61-45bb-453d-bcf0-39a923abe108 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:18.901468 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7bfe3a61-45bb-453d-bcf0-39a923abe108 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:18.902246 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7bfe3a61-45bb-453d-bcf0-39a923abe108 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:18.902696 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7bfe3a61-45bb-453d-bcf0-39a923abe108 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:19.032793 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7bfe3a61-45bb-453d-bcf0-39a923abe108 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:19.041111 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7bfe3a61-45bb-453d-bcf0-39a923abe108 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:19.042762 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7bfe3a61-45bb-453d-bcf0-39a923abe108 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:19.043896 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-7bfe3a61-45bb-453d-bcf0-39a923abe108 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1405 microversion: 2.20 time: 0.154604 May 23 16:52:19.048086 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 305/638] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:52:18 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:52:20.066629 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-158ca471-39c2-4a05-9241-48f1d4ef7686 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:20.071586 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-158ca471-39c2-4a05-9241-48f1d4ef7686 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:20.071586 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:20.074732 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-158ca471-39c2-4a05-9241-48f1d4ef7686 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:20.075183 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-158ca471-39c2-4a05-9241-48f1d4ef7686 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:20.076598 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-158ca471-39c2-4a05-9241-48f1d4ef7686 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:20.077067 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-158ca471-39c2-4a05-9241-48f1d4ef7686 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:20.124808 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-c5d33b14-42e4-4522-a3fb-752d63b3902e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:20.125377 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-c5d33b14-42e4-4522-a3fb-752d63b3902e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:20.132020 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c5d33b14-42e4-4522-a3fb-752d63b3902e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:20.132524 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c5d33b14-42e4-4522-a3fb-752d63b3902e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:20.133302 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c5d33b14-42e4-4522-a3fb-752d63b3902e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:20.133743 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c5d33b14-42e4-4522-a3fb-752d63b3902e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:20.163308 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-c5d33b14-42e4-4522-a3fb-752d63b3902e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Going to try to terminate instance {{(pid=124714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 16:52:20.211744 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-158ca471-39c2-4a05-9241-48f1d4ef7686 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:20.220086 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-158ca471-39c2-4a05-9241-48f1d4ef7686 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:20.221691 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-158ca471-39c2-4a05-9241-48f1d4ef7686 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:20.222804 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-158ca471-39c2-4a05-9241-48f1d4ef7686 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1405 microversion: 2.20 time: 0.160488 May 23 16:52:20.223363 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 334/639] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:52:20 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:52:20.513510 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-c5d33b14-42e4-4522-a3fb-752d63b3902e tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "DELETE /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 204 len: 0 microversion: 2.1 time: 0.392958 May 23 16:52:20.514195 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 306/640] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 16:52:20 2022] DELETE /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 16:52:20.522455 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-cf10012f-7763-4bef-8978-660fb95d2144 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:20.523062 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-cf10012f-7763-4bef-8978-660fb95d2144 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:20.529183 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cf10012f-7763-4bef-8978-660fb95d2144 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:20.529630 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cf10012f-7763-4bef-8978-660fb95d2144 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:20.530386 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cf10012f-7763-4bef-8978-660fb95d2144 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:20.530823 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cf10012f-7763-4bef-8978-660fb95d2144 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:20.663857 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-cf10012f-7763-4bef-8978-660fb95d2144 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:20.671934 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-cf10012f-7763-4bef-8978-660fb95d2144 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1507 microversion: 2.1 time: 0.153625 May 23 16:52:20.672588 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 335/641] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:20 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:52:21.241584 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-3c7e74cb-1bbe-48d2-893c-ac4d48f3bc4f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:21.242316 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-3c7e74cb-1bbe-48d2-893c-ac4d48f3bc4f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:21.248882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3c7e74cb-1bbe-48d2-893c-ac4d48f3bc4f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:21.249350 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3c7e74cb-1bbe-48d2-893c-ac4d48f3bc4f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:21.250118 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3c7e74cb-1bbe-48d2-893c-ac4d48f3bc4f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:21.250557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3c7e74cb-1bbe-48d2-893c-ac4d48f3bc4f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:21.266041 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:21.378638 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-3c7e74cb-1bbe-48d2-893c-ac4d48f3bc4f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:21.386445 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-3c7e74cb-1bbe-48d2-893c-ac4d48f3bc4f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:21.388067 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-3c7e74cb-1bbe-48d2-893c-ac4d48f3bc4f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:21.389265 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-3c7e74cb-1bbe-48d2-893c-ac4d48f3bc4f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1597 microversion: 2.20 time: 0.152026 May 23 16:52:21.389833 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 307/642] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:52:21 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1597 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:52:21.406786 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7261e967-3016-4d2f-af90-71419ebc903a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:21.407290 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-7261e967-3016-4d2f-af90-71419ebc903a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:21.414073 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7261e967-3016-4d2f-af90-71419ebc903a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:21.414747 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7261e967-3016-4d2f-af90-71419ebc903a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:21.415988 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7261e967-3016-4d2f-af90-71419ebc903a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:21.416824 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7261e967-3016-4d2f-af90-71419ebc903a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:21.499105 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-7261e967-3016-4d2f-af90-71419ebc903a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096114 May 23 16:52:21.499693 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 336/643] 10.222.0.74 () {60 vars in 1315 bytes} [Mon May 23 16:52:21 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 16:52:21.689859 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-62c7ee56-6019-4047-b861-96f9b256b3c7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:21.690512 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-62c7ee56-6019-4047-b861-96f9b256b3c7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:21.696706 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-62c7ee56-6019-4047-b861-96f9b256b3c7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:21.697159 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-62c7ee56-6019-4047-b861-96f9b256b3c7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:21.697939 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-62c7ee56-6019-4047-b861-96f9b256b3c7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:21.698379 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-62c7ee56-6019-4047-b861-96f9b256b3c7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:21.938861 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-62c7ee56-6019-4047-b861-96f9b256b3c7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:21.946543 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-62c7ee56-6019-4047-b861-96f9b256b3c7 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1507 microversion: 2.1 time: 0.261485 May 23 16:52:21.956517 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 308/644] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:21 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1507 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:52:22.042680 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-ffab1c70-3fea-4e9f-aa2b-344ae93e3684 req-51964020-d485-4d57-87d6-71190ee300c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5e6ec2-b063-4631-9582-9d94a739d3b7", "name": "network-vif-deleted", "tag": "e6e977d2-2ea9-45e2-bc52-5193a7346b82"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:52:22.053719 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-ffab1c70-3fea-4e9f-aa2b-344ae93e3684 req-51964020-d485-4d57-87d6-71190ee300c3 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:22.054296 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-ffab1c70-3fea-4e9f-aa2b-344ae93e3684 req-51964020-d485-4d57-87d6-71190ee300c3 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:22.069502 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-ffab1c70-3fea-4e9f-aa2b-344ae93e3684 req-51964020-d485-4d57-87d6-71190ee300c3 service nova] Creating event network-vif-deleted:e6e977d2-2ea9-45e2-bc52-5193a7346b82 for instance ff5e6ec2-b063-4631-9582-9d94a739d3b7 on hv-cinder-83925 May 23 16:52:22.074587 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-ffab1c70-3fea-4e9f-aa2b-344ae93e3684 req-51964020-d485-4d57-87d6-71190ee300c3 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035449 May 23 16:52:22.075396 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 337/645] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:52:22.688912 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-87011b91-b5a9-4b8a-97a8-f51ac2094b16 req-2388e11a-d4b2-46f2-b170-63c3beed154b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa18b171-8b37-4fcc-b7e9-e50494e967af", "tag": "7fc3fb4c-c736-453c-a8e0-bd34a6233442"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:52:22.697571 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-87011b91-b5a9-4b8a-97a8-f51ac2094b16 req-2388e11a-d4b2-46f2-b170-63c3beed154b service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:22.698020 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-87011b91-b5a9-4b8a-97a8-f51ac2094b16 req-2388e11a-d4b2-46f2-b170-63c3beed154b service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:22.712056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-87011b91-b5a9-4b8a-97a8-f51ac2094b16 req-2388e11a-d4b2-46f2-b170-63c3beed154b service nova] Creating event network-changed:7fc3fb4c-c736-453c-a8e0-bd34a6233442 for instance fa18b171-8b37-4fcc-b7e9-e50494e967af on hv-cinder-83925 May 23 16:52:22.717692 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-87011b91-b5a9-4b8a-97a8-f51ac2094b16 req-2388e11a-d4b2-46f2-b170-63c3beed154b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032990 May 23 16:52:22.718526 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 309/646] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:52:22.969187 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-fd3404a2-be52-455f-9c07-20e7ac9fd8fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:22.969187 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-fd3404a2-be52-455f-9c07-20e7ac9fd8fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:22.973916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fd3404a2-be52-455f-9c07-20e7ac9fd8fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:22.974797 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fd3404a2-be52-455f-9c07-20e7ac9fd8fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:22.975905 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fd3404a2-be52-455f-9c07-20e7ac9fd8fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:22.976494 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fd3404a2-be52-455f-9c07-20e7ac9fd8fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:23.016201 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fd3404a2-be52-455f-9c07-20e7ac9fd8fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:23.016866 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fd3404a2-be52-455f-9c07-20e7ac9fd8fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:23.017661 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.objects.instance [None req-fd3404a2-be52-455f-9c07-20e7ac9fd8fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lazy-loading 'fault' on Instance uuid ff5e6ec2-b063-4631-9582-9d94a739d3b7 {{(pid=124715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:52:23.071559 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-fd3404a2-be52-455f-9c07-20e7ac9fd8fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:23.080587 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-fd3404a2-be52-455f-9c07-20e7ac9fd8fc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 200 len: 1312 microversion: 2.1 time: 0.120474 May 23 16:52:23.081320 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 338/647] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:22 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 1312 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:52:24.099952 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-1f451294-598a-4692-98ae-8ea900ee2710 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:24.100607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-1f451294-598a-4692-98ae-8ea900ee2710 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: ff5e6ec2-b063-4631-9582-9d94a739d3b7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:24.107680 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1f451294-598a-4692-98ae-8ea900ee2710 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:24.108151 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1f451294-598a-4692-98ae-8ea900ee2710 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:24.108966 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1f451294-598a-4692-98ae-8ea900ee2710 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:24.109410 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1f451294-598a-4692-98ae-8ea900ee2710 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:24.122413 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-1f451294-598a-4692-98ae-8ea900ee2710 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] HTTP exception thrown: Instance ff5e6ec2-b063-4631-9582-9d94a739d3b7 could not be found. May 23 16:52:24.137672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-1f451294-598a-4692-98ae-8ea900ee2710 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Request method failure captured: May 23 16:52:24.137672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 HTTP/1.1 May 23 16:52:24.137672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:52:24.137672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:52:24.137672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:52:24.137672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 16:52:24.137672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:52:24.137672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:52:24.137672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:52:24.137672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:52:24.137672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7o2WukSo8MVh2vnrT0Gb8xsUoVX_gA4ZRtYP_ktCPbSO2DDauFM_C7u7kWk3VGOZRNEQJWCkkdSQViJZ1u-fzhESfTWj231c6MIBn8Mmt4wfYftDRBPMAgBmDWUt7URCKm3USy34i6WhHz3kcqn7lqeWxjid60wtGzqVjLxfEi2w6I May 23 16:52:24.137672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:52:24.137672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:52:24.137672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:52:24.137672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:52:24.137672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:52:24.137672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:52:24.137672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: 8c4eba5d39e545cbb8380490c86045f0 May 23 16:52:24.137672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-8767631 May 23 16:52:24.137672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:52:24.137672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:52:24.139782 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8c4eba5d39e545cbb8380490c86045f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8c4eba5d39e545cbb8380490c86045f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8c4eba5d39e545cbb8380490c86045f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8c4eba5d39e545cbb8380490c86045f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:52:24.139782 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-ServerRescueNegativeTestJSON-8767631 May 23 16:52:24.139782 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: 8c4eba5d39e545cbb8380490c86045f0 May 23 16:52:24.139782 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-8767631 May 23 16:52:24.139782 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-ServerRescueNegativeTestJSON-8767631-project May 23 16:52:24.139782 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:52:24.139782 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:52:24.139782 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: f14f77bc65fd4ff0bc1ec6de35846f14 May 23 16:52:24.139782 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-ServerRescueNegativeTestJSON-8767631-project May 23 16:52:24.139782 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: > May 23 16:52:24.139782 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Instance ff5e6ec2-b063-4631-9582-9d94a739d3b7 could not be found. May 23 16:52:24.139782 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': 'ff5e6ec2-b063-4631-9582-9d94a739d3b7'} May 23 16:52:24.140729 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:52:24.140729 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:52:24.140729 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:52:24.140729 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:52:24.140729 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:52:24.140729 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:52:24.140729 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:52:24.140729 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:52:24.140729 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:52:24.140729 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:52:24.140729 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff5e6ec2-b063-4631-9582-9d94a739d3b7 could not be found. May 23 16:52:24.140729 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:52:24.140729 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:52:24.140729 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:52:24.140729 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:52:24.140729 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:52:24.140729 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:52:24.140729 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:52:24.140729 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:52:24.140729 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:52:24.142271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:52:24.142271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:52:24.142271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:52:24.142271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:52:24.142271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:52:24.142271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:52:24.142271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:52:24.142271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff5e6ec2-b063-4631-9582-9d94a739d3b7 could not be found. May 23 16:52:24.142271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:52:24.142271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:52:24.142271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:52:24.142271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:52:24.142271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:52:24.142271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:52:24.142271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:52:24.142271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:52:24.142271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff5e6ec2-b063-4631-9582-9d94a739d3b7 could not be found. May 23 16:52:24.142271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:52:24.143618 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-1f451294-598a-4692-98ae-8ea900ee2710 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Returning 404 to user: Instance ff5e6ec2-b063-4631-9582-9d94a739d3b7 could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:52:24.143618 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-1f451294-598a-4692-98ae-8ea900ee2710 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7" status: 404 len: 111 microversion: 2.1 time: 0.030588 May 23 16:52:24.143618 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 310/648] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:24 2022] GET /compute/v2.1/servers/ff5e6ec2-b063-4631-9582-9d94a739d3b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:52:24.143889 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-5ab47c55-0a6d-481d-b6f8-970ad6eee41f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:24.143889 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-5ab47c55-0a6d-481d-b6f8-970ad6eee41f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:24.143889 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5ab47c55-0a6d-481d-b6f8-970ad6eee41f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:24.143889 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5ab47c55-0a6d-481d-b6f8-970ad6eee41f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:24.144597 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5ab47c55-0a6d-481d-b6f8-970ad6eee41f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:24.144597 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5ab47c55-0a6d-481d-b6f8-970ad6eee41f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:24.169621 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-5ab47c55-0a6d-481d-b6f8-970ad6eee41f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Going to try to terminate instance {{(pid=124715) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 16:52:24.360652 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-5ab47c55-0a6d-481d-b6f8-970ad6eee41f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "DELETE /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 204 len: 0 microversion: 2.1 time: 0.230023 May 23 16:52:24.361199 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 339/649] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 16:52:24 2022] DELETE /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 16:52:24.369363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ffd53a91-eef6-4345-bf42-9f680c61812b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:24.369984 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ffd53a91-eef6-4345-bf42-9f680c61812b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:24.376235 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ffd53a91-eef6-4345-bf42-9f680c61812b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:24.376727 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ffd53a91-eef6-4345-bf42-9f680c61812b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:24.377494 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ffd53a91-eef6-4345-bf42-9f680c61812b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:24.377937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ffd53a91-eef6-4345-bf42-9f680c61812b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:24.506801 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ffd53a91-eef6-4345-bf42-9f680c61812b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:24.515119 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ffd53a91-eef6-4345-bf42-9f680c61812b tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.149758 May 23 16:52:24.515687 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 311/650] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:24 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:52:25.534373 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-91e4b05a-1374-436d-b7c3-531d307dcb69 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:25.535079 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-91e4b05a-1374-436d-b7c3-531d307dcb69 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:25.541600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-91e4b05a-1374-436d-b7c3-531d307dcb69 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:25.542055 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-91e4b05a-1374-436d-b7c3-531d307dcb69 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:25.542819 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-91e4b05a-1374-436d-b7c3-531d307dcb69 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:25.543260 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-91e4b05a-1374-436d-b7c3-531d307dcb69 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:25.683769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-91e4b05a-1374-436d-b7c3-531d307dcb69 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:25.691241 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-91e4b05a-1374-436d-b7c3-531d307dcb69 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.162252 May 23 16:52:25.691805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 340/651] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:25 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:52:26.709042 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-d7eb9eab-a4c0-4f65-a0d3-9e26d5fec811 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:26.709948 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-d7eb9eab-a4c0-4f65-a0d3-9e26d5fec811 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:26.716769 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d7eb9eab-a4c0-4f65-a0d3-9e26d5fec811 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:26.717220 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d7eb9eab-a4c0-4f65-a0d3-9e26d5fec811 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:26.717988 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d7eb9eab-a4c0-4f65-a0d3-9e26d5fec811 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:26.718424 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d7eb9eab-a4c0-4f65-a0d3-9e26d5fec811 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:26.845611 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-d7eb9eab-a4c0-4f65-a0d3-9e26d5fec811 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:26.853100 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-d7eb9eab-a4c0-4f65-a0d3-9e26d5fec811 tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1521 microversion: 2.1 time: 0.148804 May 23 16:52:26.853670 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 312/652] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:26 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:52:27.652477 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-111331a1-a7f7-43d9-9b5c-dd3f1d7f684f req-82c907a4-3243-4110-9f3c-86b87b78bcb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ff57504-04ce-414c-b676-fb6bcec4cccf", "name": "network-vif-deleted", "tag": "a89d6674-fb70-4453-b26a-4eb162b70152"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:52:27.661575 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-111331a1-a7f7-43d9-9b5c-dd3f1d7f684f req-82c907a4-3243-4110-9f3c-86b87b78bcb9 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:27.666730 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-111331a1-a7f7-43d9-9b5c-dd3f1d7f684f req-82c907a4-3243-4110-9f3c-86b87b78bcb9 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:27.674999 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-111331a1-a7f7-43d9-9b5c-dd3f1d7f684f req-82c907a4-3243-4110-9f3c-86b87b78bcb9 service nova] Creating event network-vif-deleted:a89d6674-fb70-4453-b26a-4eb162b70152 for instance 2ff57504-04ce-414c-b676-fb6bcec4cccf on hv-cinder-83925 May 23 16:52:27.680483 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-111331a1-a7f7-43d9-9b5c-dd3f1d7f684f req-82c907a4-3243-4110-9f3c-86b87b78bcb9 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032075 May 23 16:52:27.681155 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 341/653] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:52:27.871558 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-d2bacd89-5b82-4c03-933c-1d61b883fd2f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:27.872113 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-d2bacd89-5b82-4c03-933c-1d61b883fd2f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:27.878669 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d2bacd89-5b82-4c03-933c-1d61b883fd2f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:27.879119 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d2bacd89-5b82-4c03-933c-1d61b883fd2f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:27.879879 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d2bacd89-5b82-4c03-933c-1d61b883fd2f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:27.880340 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d2bacd89-5b82-4c03-933c-1d61b883fd2f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:27.954692 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-d2bacd89-5b82-4c03-933c-1d61b883fd2f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14f77bc65fd4ff0bc1ec6de35846f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4eba5d39e545cbb8380490c86045f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:27.962980 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-d2bacd89-5b82-4c03-933c-1d61b883fd2f tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 200 len: 1307 microversion: 2.1 time: 0.095354 May 23 16:52:27.963573 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 313/654] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:27 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:52:28.981341 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-288a3597-1fcb-4d3e-8fe3-7fa1eee026cc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:28.982059 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-288a3597-1fcb-4d3e-8fe3-7fa1eee026cc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] [instance: 2ff57504-04ce-414c-b676-fb6bcec4cccf] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:28.988683 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-288a3597-1fcb-4d3e-8fe3-7fa1eee026cc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:28.989138 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-288a3597-1fcb-4d3e-8fe3-7fa1eee026cc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:28.989903 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-288a3597-1fcb-4d3e-8fe3-7fa1eee026cc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:28.990340 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-288a3597-1fcb-4d3e-8fe3-7fa1eee026cc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:29.004560 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-288a3597-1fcb-4d3e-8fe3-7fa1eee026cc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] HTTP exception thrown: Instance 2ff57504-04ce-414c-b676-fb6bcec4cccf could not be found. May 23 16:52:29.006134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-288a3597-1fcb-4d3e-8fe3-7fa1eee026cc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Request method failure captured: May 23 16:52:29.006134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf HTTP/1.1 May 23 16:52:29.006134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:52:29.006134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:52:29.006134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:52:29.006134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:52:29.006134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:52:29.006134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:52:29.006134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:52:29.006134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:52:29.006134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7o2WukSo8MVh2vnrT0Gb8xsUoVX_gA4ZRtYP_ktCPbSO2DDauFM_C7u7kWk3VGOZRNEQJWCkkdSQViJZ1u-fzhESfTWj231c6MIBn8Mmt4wfYftDRBPMAgBmDWUt7URCKm3USy34i6WhHz3kcqn7lqeWxjid60wtGzqVjLxfEi2w6I May 23 16:52:29.006134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:52:29.006134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:52:29.006134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:52:29.006134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:52:29.006134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:52:29.006134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:52:29.006134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: 8c4eba5d39e545cbb8380490c86045f0 May 23 16:52:29.006134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-8767631 May 23 16:52:29.006134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:52:29.006134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:52:29.007646 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8c4eba5d39e545cbb8380490c86045f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8c4eba5d39e545cbb8380490c86045f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8c4eba5d39e545cbb8380490c86045f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8c4eba5d39e545cbb8380490c86045f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:52:29.007646 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-ServerRescueNegativeTestJSON-8767631 May 23 16:52:29.007646 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: 8c4eba5d39e545cbb8380490c86045f0 May 23 16:52:29.007646 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-8767631 May 23 16:52:29.007646 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-ServerRescueNegativeTestJSON-8767631-project May 23 16:52:29.007646 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:52:29.007646 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:52:29.007646 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: f14f77bc65fd4ff0bc1ec6de35846f14 May 23 16:52:29.007646 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-ServerRescueNegativeTestJSON-8767631-project May 23 16:52:29.007646 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 16:52:29.007646 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Instance 2ff57504-04ce-414c-b676-fb6bcec4cccf could not be found. May 23 16:52:29.007646 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': '2ff57504-04ce-414c-b676-fb6bcec4cccf'} May 23 16:52:29.008506 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:52:29.008506 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:52:29.008506 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:52:29.008506 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:52:29.008506 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:52:29.008506 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:52:29.008506 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:52:29.008506 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:52:29.008506 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:52:29.008506 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:52:29.008506 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ff57504-04ce-414c-b676-fb6bcec4cccf could not be found. May 23 16:52:29.008506 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:52:29.008506 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:52:29.008506 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:52:29.008506 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:52:29.008506 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:52:29.008506 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:52:29.008506 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:52:29.008506 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:52:29.008506 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:52:29.009697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:52:29.009697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:52:29.009697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:52:29.009697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:52:29.009697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:52:29.009697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:52:29.009697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:52:29.009697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ff57504-04ce-414c-b676-fb6bcec4cccf could not be found. May 23 16:52:29.009697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:52:29.009697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:52:29.009697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:52:29.009697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:52:29.009697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:52:29.009697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:52:29.009697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:52:29.009697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:52:29.009697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ff57504-04ce-414c-b676-fb6bcec4cccf could not be found. May 23 16:52:29.009697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:52:29.010842 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-288a3597-1fcb-4d3e-8fe3-7fa1eee026cc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] Returning 404 to user: Instance 2ff57504-04ce-414c-b676-fb6bcec4cccf could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:52:29.010842 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-288a3597-1fcb-4d3e-8fe3-7fa1eee026cc tempest-ServerRescueNegativeTestJSON-8767631 tempest-ServerRescueNegativeTestJSON-8767631-project] 10.222.0.74 "GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf" status: 404 len: 111 microversion: 2.1 time: 0.030448 May 23 16:52:29.010842 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 342/655] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:28 2022] GET /compute/v2.1/servers/2ff57504-04ce-414c-b676-fb6bcec4cccf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:52:33.992809 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-967cd83a-4b0d-478a-ae89-7b7032d4d7e3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1375700589"}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:52:33.993372 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-967cd83a-4b0d-478a-ae89-7b7032d4d7e3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:33.996065 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:34.001658 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-967cd83a-4b0d-478a-ae89-7b7032d4d7e3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:34.002113 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-967cd83a-4b0d-478a-ae89-7b7032d4d7e3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:34.002879 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-967cd83a-4b0d-478a-ae89-7b7032d4d7e3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:34.003312 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-967cd83a-4b0d-478a-ae89-7b7032d4d7e3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:34.131364 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.network.security_group_api [None req-967cd83a-4b0d-478a-ae89-7b7032d4d7e3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Removing security group 120eca0c-f193-4e4f-a405-6d8ad7a2cf9d from port 5141686c-093d-45da-8646-a43dcece1e63 May 23 16:52:34.609408 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-967cd83a-4b0d-478a-ae89-7b7032d4d7e3 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "POST /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089/action" status: 202 len: 0 microversion: 2.1 time: 0.620247 May 23 16:52:34.619328 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 314/656] 10.222.0.74 () {60 vars in 1277 bytes} [Mon May 23 16:52:33 2022] POST /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089/action => generated 0 bytes in 630 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:52:34.623796 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-0f44f421-befa-4d85-a934-2cf3519b5778 req-4dcf1353-09f3-4b02-8bdf-1784837fe1fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e337be75-f64c-4c86-97f1-e31cf55a6089", "tag": "5141686c-093d-45da-8646-a43dcece1e63"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:52:34.637833 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-0f44f421-befa-4d85-a934-2cf3519b5778 req-4dcf1353-09f3-4b02-8bdf-1784837fe1fe service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:34.638667 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-0f44f421-befa-4d85-a934-2cf3519b5778 req-4dcf1353-09f3-4b02-8bdf-1784837fe1fe service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:34.666648 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-0f44f421-befa-4d85-a934-2cf3519b5778 req-4dcf1353-09f3-4b02-8bdf-1784837fe1fe service nova] Creating event network-changed:5141686c-093d-45da-8646-a43dcece1e63 for instance e337be75-f64c-4c86-97f1-e31cf55a6089 on hv-cinder-83925 May 23 16:52:34.681638 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-0f44f421-befa-4d85-a934-2cf3519b5778 req-4dcf1353-09f3-4b02-8bdf-1784837fe1fe service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063315 May 23 16:52:34.687687 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 343/657] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:52:36.085396 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-6dabc0a6-3c03-4f83-a3d0-eed2aa857978 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:36.086466 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-6dabc0a6-3c03-4f83-a3d0-eed2aa857978 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:36.092837 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6dabc0a6-3c03-4f83-a3d0-eed2aa857978 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:36.093293 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6dabc0a6-3c03-4f83-a3d0-eed2aa857978 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:36.094063 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6dabc0a6-3c03-4f83-a3d0-eed2aa857978 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:36.094499 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6dabc0a6-3c03-4f83-a3d0-eed2aa857978 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:36.176175 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.objects.instance [None req-6dabc0a6-3c03-4f83-a3d0-eed2aa857978 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lazy-loading 'services' on Instance uuid e337be75-f64c-4c86-97f1-e31cf55a6089 {{(pid=124714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:52:36.417715 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-6dabc0a6-3c03-4f83-a3d0-eed2aa857978 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "DELETE /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089/os-volume_attachments/f28cb943-4e4e-4b94-8604-20ac5df89122" status: 202 len: 0 microversion: 2.1 time: 0.336790 May 23 16:52:36.418537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 315/658] 10.222.0.74 () {58 vars in 1415 bytes} [Mon May 23 16:52:36 2022] DELETE /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089/os-volume_attachments/f28cb943-4e4e-4b94-8604-20ac5df89122 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:52:36.428058 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-4cf61a27-e1b3-4d85-b7ca-7dedca501245 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:36.430034 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-4cf61a27-e1b3-4d85-b7ca-7dedca501245 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:36.437922 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4cf61a27-e1b3-4d85-b7ca-7dedca501245 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:36.438409 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4cf61a27-e1b3-4d85-b7ca-7dedca501245 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:36.439215 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4cf61a27-e1b3-4d85-b7ca-7dedca501245 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:36.439807 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4cf61a27-e1b3-4d85-b7ca-7dedca501245 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:36.471833 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-4cf61a27-e1b3-4d85-b7ca-7dedca501245 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048681 May 23 16:52:36.472423 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 344/659] 10.222.0.74 () {58 vars in 1301 bytes} [Mon May 23 16:52:36 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:52:36.697674 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-6ff59ae2-8cba-464e-9765-a6aa020e5b95 req-b36320a5-a2fb-42d6-ae37-0633ad4d1e43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e337be75-f64c-4c86-97f1-e31cf55a6089", "tag": "5141686c-093d-45da-8646-a43dcece1e63"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:52:36.707091 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-6ff59ae2-8cba-464e-9765-a6aa020e5b95 req-b36320a5-a2fb-42d6-ae37-0633ad4d1e43 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:36.707628 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-6ff59ae2-8cba-464e-9765-a6aa020e5b95 req-b36320a5-a2fb-42d6-ae37-0633ad4d1e43 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:36.720028 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-6ff59ae2-8cba-464e-9765-a6aa020e5b95 req-b36320a5-a2fb-42d6-ae37-0633ad4d1e43 service nova] Creating event network-changed:5141686c-093d-45da-8646-a43dcece1e63 for instance e337be75-f64c-4c86-97f1-e31cf55a6089 on hv-cinder-83925 May 23 16:52:36.729492 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-6ff59ae2-8cba-464e-9765-a6aa020e5b95 req-b36320a5-a2fb-42d6-ae37-0633ad4d1e43 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035624 May 23 16:52:36.730465 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 316/660] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:52:37.483930 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-f7e44ee1-a1ad-4e3f-b2ee-0c646d24f8c9 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:37.485199 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-f7e44ee1-a1ad-4e3f-b2ee-0c646d24f8c9 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:37.493421 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f7e44ee1-a1ad-4e3f-b2ee-0c646d24f8c9 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:37.493994 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f7e44ee1-a1ad-4e3f-b2ee-0c646d24f8c9 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:37.495039 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f7e44ee1-a1ad-4e3f-b2ee-0c646d24f8c9 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:37.495544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f7e44ee1-a1ad-4e3f-b2ee-0c646d24f8c9 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:37.500230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:37.525286 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-f7e44ee1-a1ad-4e3f-b2ee-0c646d24f8c9 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045928 May 23 16:52:37.525989 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 345/661] 10.222.0.74 () {58 vars in 1301 bytes} [Mon May 23 16:52:37 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:52:38.538962 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-d21b6fb7-5126-4b2a-b527-1d023c5aba7b tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:38.540017 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-d21b6fb7-5126-4b2a-b527-1d023c5aba7b tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:38.547192 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d21b6fb7-5126-4b2a-b527-1d023c5aba7b tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:38.547649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d21b6fb7-5126-4b2a-b527-1d023c5aba7b tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:38.548468 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d21b6fb7-5126-4b2a-b527-1d023c5aba7b tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:38.548913 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d21b6fb7-5126-4b2a-b527-1d023c5aba7b tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:38.580323 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-d21b6fb7-5126-4b2a-b527-1d023c5aba7b tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046296 May 23 16:52:38.581128 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 317/662] 10.222.0.74 () {58 vars in 1301 bytes} [Mon May 23 16:52:38 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 16:52:38.592188 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-72925984-94ea-4d71-9aaa-0ec9c9b7cc68 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:38.593011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-72925984-94ea-4d71-9aaa-0ec9c9b7cc68 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:38.600099 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-72925984-94ea-4d71-9aaa-0ec9c9b7cc68 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:38.600580 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-72925984-94ea-4d71-9aaa-0ec9c9b7cc68 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:38.601354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-72925984-94ea-4d71-9aaa-0ec9c9b7cc68 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:38.601791 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-72925984-94ea-4d71-9aaa-0ec9c9b7cc68 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:38.683165 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-72925984-94ea-4d71-9aaa-0ec9c9b7cc68 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] HTTP exception thrown: Instance e337be75-f64c-4c86-97f1-e31cf55a6089 is not attached to volume f28cb943-4e4e-4b94-8604-20ac5df89122 May 23 16:52:38.691884 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-72925984-94ea-4d71-9aaa-0ec9c9b7cc68 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Request method failure captured: May 23 16:52:38.691884 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: DELETE /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089/os-volume_attachments/f28cb943-4e4e-4b94-8604-20ac5df89122 HTTP/1.1 May 23 16:52:38.691884 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:52:38.691884 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:52:38.691884 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:52:38.691884 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:52:38.691884 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:52:38.691884 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:52:38.691884 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:52:38.691884 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:52:38.691884 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7ru2b6PBIM9S6yn-uq3uWwtLoUwHK6g-xdUtcZAjcdlAbUteUIrgd7iARmQf1HEj-arXt6yyykwSC5YCQnsgLngXW1BikPUF3UaTHNY1UXZ6UzgpOi3Rqg-PzMLBILnew3xXplbUuKYuBLlqXt9HT7z0hbJE-h8lwyTEwRv4jcOij8 May 23 16:52:38.691884 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:52:38.691884 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:52:38.691884 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:52:38.691884 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:52:38.691884 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:52:38.691884 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:52:38.691884 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: 74aa5dda63754f62b71d74fcaa4bee01 May 23 16:52:38.691884 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-TestMinimumBasicScenario-1627051893 May 23 16:52:38.691884 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:52:38.691884 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:52:38.693552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/74aa5dda63754f62b71d74fcaa4bee01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/74aa5dda63754f62b71d74fcaa4bee01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/74aa5dda63754f62b71d74fcaa4bee01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_74aa5dda63754f62b71d74fcaa4bee01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:52:38.693552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-TestMinimumBasicScenario-1627051893 May 23 16:52:38.693552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: 74aa5dda63754f62b71d74fcaa4bee01 May 23 16:52:38.693552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1627051893 May 23 16:52:38.693552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-TestMinimumBasicScenario-1627051893-project May 23 16:52:38.693552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:52:38.693552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:52:38.693552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: 3d8a088405d549cda80615fd41a661c0 May 23 16:52:38.693552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-TestMinimumBasicScenario-1627051893-project May 23 16:52:38.693552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 16:52:38.693552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Instance e337be75-f64c-4c86-97f1-e31cf55a6089 is not attached to volume f28cb943-4e4e-4b94-8604-20ac5df89122 May 23 16:52:38.694474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'server_id': 'e337be75-f64c-4c86-97f1-e31cf55a6089', 'id': 'f28cb943-4e4e-4b94-8604-20ac5df89122'} May 23 16:52:38.694474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:52:38.694474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:52:38.694474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 23 16:52:38.694474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 23 16:52:38.694474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 16:52:38.694474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 16:52:38.694474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 23 16:52:38.694474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 23 16:52:38.694474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f28cb943-4e4e-4b94-8604-20ac5df89122. May 23 16:52:38.694474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:52:38.694474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:52:38.694474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:52:38.694474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:52:38.694474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:52:38.694474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:52:38.694474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:52:38.694474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:52:38.694474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:52:38.695847 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:52:38.695847 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 23 16:52:38.695847 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 23 16:52:38.695847 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e337be75-f64c-4c86-97f1-e31cf55a6089 is not attached to volume f28cb943-4e4e-4b94-8604-20ac5df89122 May 23 16:52:38.695847 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:52:38.695847 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:52:38.695847 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:52:38.695847 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:52:38.695847 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:52:38.695847 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:52:38.695847 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:52:38.695847 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:52:38.695847 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e337be75-f64c-4c86-97f1-e31cf55a6089 is not attached to volume f28cb943-4e4e-4b94-8604-20ac5df89122 May 23 16:52:38.695847 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:52:38.695847 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-72925984-94ea-4d71-9aaa-0ec9c9b7cc68 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Returning 404 to user: Instance e337be75-f64c-4c86-97f1-e31cf55a6089 is not attached to volume f28cb943-4e4e-4b94-8604-20ac5df89122 {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:52:38.697445 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-72925984-94ea-4d71-9aaa-0ec9c9b7cc68 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "DELETE /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089/os-volume_attachments/f28cb943-4e4e-4b94-8604-20ac5df89122" status: 404 len: 154 microversion: 2.1 time: 0.107952 May 23 16:52:38.697445 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 346/663] 10.222.0.74 () {58 vars in 1415 bytes} [Mon May 23 16:52:38 2022] DELETE /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089/os-volume_attachments/f28cb943-4e4e-4b94-8604-20ac5df89122 => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:52:39.985910 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-77ae01f7-4539-4cea-bf13-ee2e4b93f389 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:39.987073 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-77ae01f7-4539-4cea-bf13-ee2e4b93f389 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:39.993734 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-77ae01f7-4539-4cea-bf13-ee2e4b93f389 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:39.994195 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-77ae01f7-4539-4cea-bf13-ee2e4b93f389 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:39.995156 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-77ae01f7-4539-4cea-bf13-ee2e4b93f389 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:39.995600 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-77ae01f7-4539-4cea-bf13-ee2e4b93f389 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:40.023927 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-77ae01f7-4539-4cea-bf13-ee2e4b93f389 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Going to try to terminate instance {{(pid=124714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 16:52:40.285390 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-77ae01f7-4539-4cea-bf13-ee2e4b93f389 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "DELETE /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 204 len: 0 microversion: 2.1 time: 0.304053 May 23 16:52:40.286057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 318/664] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 16:52:39 2022] DELETE /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 16:52:40.294565 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7a3f6570-7294-4d1f-8fc4-95675a40dc89 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:40.295453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-7a3f6570-7294-4d1f-8fc4-95675a40dc89 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:40.301907 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7a3f6570-7294-4d1f-8fc4-95675a40dc89 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:40.302361 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7a3f6570-7294-4d1f-8fc4-95675a40dc89 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:40.303128 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7a3f6570-7294-4d1f-8fc4-95675a40dc89 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:40.303564 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7a3f6570-7294-4d1f-8fc4-95675a40dc89 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:40.439111 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-7a3f6570-7294-4d1f-8fc4-95675a40dc89 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:40.446798 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-7a3f6570-7294-4d1f-8fc4-95675a40dc89 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1554 microversion: 2.1 time: 0.156394 May 23 16:52:40.447374 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 347/665] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:40 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:52:41.464851 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-cba898c6-c672-4ad5-9875-612fb3135529 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:41.465560 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-cba898c6-c672-4ad5-9875-612fb3135529 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:41.473168 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cba898c6-c672-4ad5-9875-612fb3135529 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:41.473623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cba898c6-c672-4ad5-9875-612fb3135529 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:41.474408 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cba898c6-c672-4ad5-9875-612fb3135529 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:41.474850 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cba898c6-c672-4ad5-9875-612fb3135529 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:41.617708 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-cba898c6-c672-4ad5-9875-612fb3135529 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:41.617881 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-cba898c6-c672-4ad5-9875-612fb3135529 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1554 microversion: 2.1 time: 0.157281 May 23 16:52:41.618602 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 319/666] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:41 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:52:42.635472 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-f62454f3-8f34-4b1f-a6e2-5b9bf3b938c7 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:42.636180 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-f62454f3-8f34-4b1f-a6e2-5b9bf3b938c7 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:42.642904 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f62454f3-8f34-4b1f-a6e2-5b9bf3b938c7 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:42.643358 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f62454f3-8f34-4b1f-a6e2-5b9bf3b938c7 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:42.644128 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f62454f3-8f34-4b1f-a6e2-5b9bf3b938c7 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:42.644601 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f62454f3-8f34-4b1f-a6e2-5b9bf3b938c7 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:42.780046 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f62454f3-8f34-4b1f-a6e2-5b9bf3b938c7 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:42.788221 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-f62454f3-8f34-4b1f-a6e2-5b9bf3b938c7 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1554 microversion: 2.1 time: 0.156560 May 23 16:52:42.788820 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 348/667] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:42 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:52:43.334966 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-c3a8ae20-50f5-4c22-be35-597653ca945d req-d5531f98-f294-49ab-9733-4c0d0be39721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e337be75-f64c-4c86-97f1-e31cf55a6089", "name": "network-vif-deleted", "tag": "5141686c-093d-45da-8646-a43dcece1e63"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:52:43.344928 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-c3a8ae20-50f5-4c22-be35-597653ca945d req-d5531f98-f294-49ab-9733-4c0d0be39721 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:43.345445 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-c3a8ae20-50f5-4c22-be35-597653ca945d req-d5531f98-f294-49ab-9733-4c0d0be39721 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:43.357156 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-c3a8ae20-50f5-4c22-be35-597653ca945d req-d5531f98-f294-49ab-9733-4c0d0be39721 service nova] Creating event network-vif-deleted:5141686c-093d-45da-8646-a43dcece1e63 for instance e337be75-f64c-4c86-97f1-e31cf55a6089 on hv-cinder-83925 May 23 16:52:43.362821 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-c3a8ae20-50f5-4c22-be35-597653ca945d req-d5531f98-f294-49ab-9733-4c0d0be39721 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032222 May 23 16:52:43.363406 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 320/668] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:52:43.807300 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-aea0322c-f6bf-4366-a328-a5ecd3fb471d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:43.807921 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-aea0322c-f6bf-4366-a328-a5ecd3fb471d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:43.815676 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-aea0322c-f6bf-4366-a328-a5ecd3fb471d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:43.816127 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-aea0322c-f6bf-4366-a328-a5ecd3fb471d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:43.817040 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-aea0322c-f6bf-4366-a328-a5ecd3fb471d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:43.817481 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-aea0322c-f6bf-4366-a328-a5ecd3fb471d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:43.847452 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-aea0322c-f6bf-4366-a328-a5ecd3fb471d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:43.847900 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-aea0322c-f6bf-4366-a328-a5ecd3fb471d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:43.848510 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.objects.instance [None req-aea0322c-f6bf-4366-a328-a5ecd3fb471d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lazy-loading 'fault' on Instance uuid e337be75-f64c-4c86-97f1-e31cf55a6089 {{(pid=124715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:52:43.893729 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-aea0322c-f6bf-4366-a328-a5ecd3fb471d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8a088405d549cda80615fd41a661c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74aa5dda63754f62b71d74fcaa4bee01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:52:43.901287 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-aea0322c-f6bf-4366-a328-a5ecd3fb471d tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 200 len: 1348 microversion: 2.1 time: 0.097925 May 23 16:52:43.903760 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 349/669] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:43 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:52:44.920275 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-140ad0a1-7a32-457e-86b7-f14bf4c287b5 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:44.921162 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-140ad0a1-7a32-457e-86b7-f14bf4c287b5 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] [instance: e337be75-f64c-4c86-97f1-e31cf55a6089] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:44.927358 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-140ad0a1-7a32-457e-86b7-f14bf4c287b5 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:44.927800 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-140ad0a1-7a32-457e-86b7-f14bf4c287b5 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:44.928668 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-140ad0a1-7a32-457e-86b7-f14bf4c287b5 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:44.929100 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-140ad0a1-7a32-457e-86b7-f14bf4c287b5 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:44.942191 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-140ad0a1-7a32-457e-86b7-f14bf4c287b5 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] HTTP exception thrown: Instance e337be75-f64c-4c86-97f1-e31cf55a6089 could not be found. May 23 16:52:44.943764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-140ad0a1-7a32-457e-86b7-f14bf4c287b5 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Request method failure captured: May 23 16:52:44.943764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 HTTP/1.1 May 23 16:52:44.943764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:52:44.943764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:52:44.943764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:52:44.943764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 16:52:44.943764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:52:44.943764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:52:44.943764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:52:44.943764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:52:44.943764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7ru2b6PBIM9S6yn-uq3uWwtLoUwHK6g-xdUtcZAjcdlAbUteUIrgd7iARmQf1HEj-arXt6yyykwSC5YCQnsgLngXW1BikPUF3UaTHNY1UXZ6UzgpOi3Rqg-PzMLBILnew3xXplbUuKYuBLlqXt9HT7z0hbJE-h8lwyTEwRv4jcOij8 May 23 16:52:44.943764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:52:44.943764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:52:44.943764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:52:44.943764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:52:44.943764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:52:44.943764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:52:44.943764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: 74aa5dda63754f62b71d74fcaa4bee01 May 23 16:52:44.943764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-TestMinimumBasicScenario-1627051893 May 23 16:52:44.943764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:52:44.943764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:52:44.945269 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/74aa5dda63754f62b71d74fcaa4bee01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/74aa5dda63754f62b71d74fcaa4bee01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/74aa5dda63754f62b71d74fcaa4bee01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_74aa5dda63754f62b71d74fcaa4bee01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:52:44.945269 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-TestMinimumBasicScenario-1627051893 May 23 16:52:44.945269 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: 74aa5dda63754f62b71d74fcaa4bee01 May 23 16:52:44.945269 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1627051893 May 23 16:52:44.945269 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-TestMinimumBasicScenario-1627051893-project May 23 16:52:44.945269 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:52:44.945269 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:52:44.945269 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 3d8a088405d549cda80615fd41a661c0 May 23 16:52:44.945269 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-TestMinimumBasicScenario-1627051893-project May 23 16:52:44.945269 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: > May 23 16:52:44.945269 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Instance e337be75-f64c-4c86-97f1-e31cf55a6089 could not be found. May 23 16:52:44.945269 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': 'e337be75-f64c-4c86-97f1-e31cf55a6089'} May 23 16:52:44.946071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:52:44.946071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:52:44.946071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:52:44.946071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:52:44.946071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:52:44.946071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:52:44.946071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:52:44.946071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:52:44.946071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:52:44.946071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:52:44.946071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e337be75-f64c-4c86-97f1-e31cf55a6089 could not be found. May 23 16:52:44.946071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:52:44.946071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:52:44.946071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:52:44.946071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:52:44.946071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:52:44.946071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:52:44.946071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:52:44.946071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:52:44.946071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:52:44.947447 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:52:44.947447 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:52:44.947447 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:52:44.947447 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:52:44.947447 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:52:44.947447 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:52:44.947447 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:52:44.947447 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e337be75-f64c-4c86-97f1-e31cf55a6089 could not be found. May 23 16:52:44.947447 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:52:44.947447 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:52:44.947447 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:52:44.947447 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:52:44.947447 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:52:44.947447 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:52:44.947447 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:52:44.947447 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:52:44.947447 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e337be75-f64c-4c86-97f1-e31cf55a6089 could not be found. May 23 16:52:44.947447 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:52:44.948856 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-140ad0a1-7a32-457e-86b7-f14bf4c287b5 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Returning 404 to user: Instance e337be75-f64c-4c86-97f1-e31cf55a6089 could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:52:44.948856 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-140ad0a1-7a32-457e-86b7-f14bf4c287b5 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089" status: 404 len: 111 microversion: 2.1 time: 0.030330 May 23 16:52:44.948856 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 321/670] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:44 2022] GET /compute/v2.1/servers/e337be75-f64c-4c86-97f1-e31cf55a6089 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:52:44.954588 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-6abdfe9d-d0c7-4814-969a-ec07baa55933 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] Calling method '.version_select at 0x7f224c3aff70>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:45.047190 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-6abdfe9d-d0c7-4814-969a-ec07baa55933 tempest-TestMinimumBasicScenario-1627051893 tempest-TestMinimumBasicScenario-1627051893-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-986069349" status: 202 len: 0 microversion: 2.1 time: 0.096846 May 23 16:52:45.047955 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 350/671] 10.222.0.74 () {58 vars in 1268 bytes} [Mon May 23 16:52:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-986069349 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:52:59.386752 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-adbd305a-4fe0-4fbc-a667-f1985be6156b tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:59.387674 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-adbd305a-4fe0-4fbc-a667-f1985be6156b tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:59.389967 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:59.390647 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:59.395365 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-adbd305a-4fe0-4fbc-a667-f1985be6156b tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:59.395813 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-adbd305a-4fe0-4fbc-a667-f1985be6156b tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:59.396616 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-adbd305a-4fe0-4fbc-a667-f1985be6156b tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:59.397058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-adbd305a-4fe0-4fbc-a667-f1985be6156b tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:59.426627 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-adbd305a-4fe0-4fbc-a667-f1985be6156b tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043959 May 23 16:52:59.427133 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 322/672] 10.222.0.74 () {58 vars in 1301 bytes} [Mon May 23 16:52:59 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 16:52:59.491952 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a2f7aa82-4b0f-4286-8862-b89dc8bbf5b4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:59.492494 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a2f7aa82-4b0f-4286-8862-b89dc8bbf5b4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:59.494982 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=30 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:59.495629 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:52:59.502566 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a2f7aa82-4b0f-4286-8862-b89dc8bbf5b4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:59.503399 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a2f7aa82-4b0f-4286-8862-b89dc8bbf5b4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:59.503805 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a2f7aa82-4b0f-4286-8862-b89dc8bbf5b4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:59.504249 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a2f7aa82-4b0f-4286-8862-b89dc8bbf5b4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:59.528461 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a2f7aa82-4b0f-4286-8862-b89dc8bbf5b4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Going to try to terminate instance {{(pid=124715) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 16:52:59.844985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a2f7aa82-4b0f-4286-8862-b89dc8bbf5b4 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "DELETE /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 204 len: 0 microversion: 2.1 time: 0.356502 May 23 16:52:59.845571 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 351/673] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 16:52:59 2022] DELETE /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 16:52:59.853682 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-242ebaa3-ae3f-4157-8142-f64b2455a264 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:52:59.854295 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-242ebaa3-ae3f-4157-8142-f64b2455a264 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:52:59.862256 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-242ebaa3-ae3f-4157-8142-f64b2455a264 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:59.862700 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-242ebaa3-ae3f-4157-8142-f64b2455a264 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:59.863465 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-242ebaa3-ae3f-4157-8142-f64b2455a264 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:52:59.863903 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-242ebaa3-ae3f-4157-8142-f64b2455a264 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:52:59.998223 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-242ebaa3-ae3f-4157-8142-f64b2455a264 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:00.005810 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-242ebaa3-ae3f-4157-8142-f64b2455a264 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1673 microversion: 2.1 time: 0.156018 May 23 16:53:00.006376 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 323/674] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:52:59 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:01.023616 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-24a7c56c-79f0-4023-b8a8-6b3bc7c49f70 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:01.024352 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-24a7c56c-79f0-4023-b8a8-6b3bc7c49f70 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:01.031083 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-24a7c56c-79f0-4023-b8a8-6b3bc7c49f70 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:01.031613 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-24a7c56c-79f0-4023-b8a8-6b3bc7c49f70 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:01.032340 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-24a7c56c-79f0-4023-b8a8-6b3bc7c49f70 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:01.032786 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-24a7c56c-79f0-4023-b8a8-6b3bc7c49f70 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:01.175700 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-24a7c56c-79f0-4023-b8a8-6b3bc7c49f70 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:01.183400 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-24a7c56c-79f0-4023-b8a8-6b3bc7c49f70 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1673 microversion: 2.1 time: 0.164144 May 23 16:53:01.183978 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 352/675] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:01 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:01.881756 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-45fbc46b-543f-45d7-b9e4-0c967fe5ac9a req-6329a75e-4f44-4845-bc6b-85c71768dc74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "405bb8d2-37bb-47fc-9ea9-c432cc0bafd4", "name": "network-vif-deleted", "tag": "d9215691-0275-40e1-bf02-9d9be4c9e0e9"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:53:01.891057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-45fbc46b-543f-45d7-b9e4-0c967fe5ac9a req-6329a75e-4f44-4845-bc6b-85c71768dc74 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:01.891505 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-45fbc46b-543f-45d7-b9e4-0c967fe5ac9a req-6329a75e-4f44-4845-bc6b-85c71768dc74 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:01.902976 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-45fbc46b-543f-45d7-b9e4-0c967fe5ac9a req-6329a75e-4f44-4845-bc6b-85c71768dc74 service nova] Creating event network-vif-deleted:d9215691-0275-40e1-bf02-9d9be4c9e0e9 for instance 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 on hv-cinder-83925 May 23 16:53:01.908758 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-45fbc46b-543f-45d7-b9e4-0c967fe5ac9a req-6329a75e-4f44-4845-bc6b-85c71768dc74 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031193 May 23 16:53:01.909353 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 324/676] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:53:02.202869 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-ad7ba10f-064b-45e8-b869-67e40fdedcaf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:02.203617 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-ad7ba10f-064b-45e8-b869-67e40fdedcaf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:02.213717 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ad7ba10f-064b-45e8-b869-67e40fdedcaf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:02.214182 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ad7ba10f-064b-45e8-b869-67e40fdedcaf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:02.214959 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ad7ba10f-064b-45e8-b869-67e40fdedcaf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:02.215396 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ad7ba10f-064b-45e8-b869-67e40fdedcaf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:02.254442 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ad7ba10f-064b-45e8-b869-67e40fdedcaf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:02.255026 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ad7ba10f-064b-45e8-b869-67e40fdedcaf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:02.255597 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.objects.instance [None req-ad7ba10f-064b-45e8-b869-67e40fdedcaf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lazy-loading 'fault' on Instance uuid 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 {{(pid=124715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:53:02.323817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-ad7ba10f-064b-45e8-b869-67e40fdedcaf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:02.332552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-ad7ba10f-064b-45e8-b869-67e40fdedcaf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 200 len: 1327 microversion: 2.1 time: 0.134165 May 23 16:53:02.333440 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 353/677] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:02 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 1327 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:03.351398 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ac404d5e-f9a5-43ea-91ac-08a302c81d3d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:03.352058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ac404d5e-f9a5-43ea-91ac-08a302c81d3d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:03.358594 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ac404d5e-f9a5-43ea-91ac-08a302c81d3d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:03.359043 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ac404d5e-f9a5-43ea-91ac-08a302c81d3d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:03.359817 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ac404d5e-f9a5-43ea-91ac-08a302c81d3d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:03.360264 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ac404d5e-f9a5-43ea-91ac-08a302c81d3d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:03.374008 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-ac404d5e-f9a5-43ea-91ac-08a302c81d3d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] HTTP exception thrown: Instance 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 could not be found. May 23 16:53:03.375784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ac404d5e-f9a5-43ea-91ac-08a302c81d3d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Request method failure captured: May 23 16:53:03.375784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 HTTP/1.1 May 23 16:53:03.375784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:53:03.375784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:53:03.375784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:53:03.375784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 16:53:03.375784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:53:03.375784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:53:03.375784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:53:03.375784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:53:03.375784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7o8fTftQq8dNo83YLVJfdcwwAyPyxNSHwUl-IlxFZzI8lYpiwVJZJKo48CDOUE1Kv96p-xOEXfTHc9h05OOoAJd00McLos4eBlCi78kboMkVYqk_iAatcbtlsB28uBEmgi54fTXGOvRc_WTpKSZYYEjTn0wQq1atKL4y4n0nu2Ec0U May 23 16:53:03.375784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:53:03.375784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:53:03.375784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:53:03.375784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:53:03.375784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:53:03.375784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:53:03.375784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: c14a96662507495b84670e2f62f90f59 May 23 16:53:03.375784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-AttachVolumeTestJSON-566752418 May 23 16:53:03.375784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:53:03.375784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:53:03.380470 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c14a96662507495b84670e2f62f90f59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c14a96662507495b84670e2f62f90f59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c14a96662507495b84670e2f62f90f59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c14a96662507495b84670e2f62f90f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:53:03.380470 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-AttachVolumeTestJSON-566752418 May 23 16:53:03.380470 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: c14a96662507495b84670e2f62f90f59 May 23 16:53:03.380470 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-AttachVolumeTestJSON-566752418 May 23 16:53:03.380470 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-AttachVolumeTestJSON-566752418-project May 23 16:53:03.380470 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:53:03.380470 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:53:03.380470 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 0e90497b6d9c4a789f6b31680e069087 May 23 16:53:03.380470 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-AttachVolumeTestJSON-566752418-project May 23 16:53:03.380470 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: > May 23 16:53:03.380470 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Instance 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 could not be found. May 23 16:53:03.380470 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': '405bb8d2-37bb-47fc-9ea9-c432cc0bafd4'} May 23 16:53:03.381537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:53:03.381537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:53:03.381537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:53:03.381537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:53:03.381537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:53:03.381537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:53:03.381537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:53:03.381537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:53:03.381537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:53:03.381537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:53:03.381537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 could not be found. May 23 16:53:03.381537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:53:03.381537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:53:03.381537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:53:03.381537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:53:03.381537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:53:03.381537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:53:03.381537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:53:03.381537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:53:03.381537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:53:03.383064 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:53:03.383064 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:53:03.383064 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:53:03.383064 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:53:03.383064 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:53:03.383064 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:53:03.383064 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:53:03.383064 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 could not be found. May 23 16:53:03.383064 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:53:03.383064 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:53:03.383064 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:53:03.383064 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:53:03.383064 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:53:03.383064 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:53:03.383064 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:53:03.383064 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:53:03.383064 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 could not be found. May 23 16:53:03.383064 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:53:03.384435 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ac404d5e-f9a5-43ea-91ac-08a302c81d3d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Returning 404 to user: Instance 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:53:03.384435 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ac404d5e-f9a5-43ea-91ac-08a302c81d3d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 404 len: 111 microversion: 2.1 time: 0.030645 May 23 16:53:03.384435 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 325/678] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:03 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:53:03.386514 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-de58d268-c4b6-4dde-af9d-7c0ca22ee2e1 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '.version_select at 0x7f224c3cc040>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:03.486182 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-de58d268-c4b6-4dde-af9d-7c0ca22ee2e1 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1691468904" status: 202 len: 0 microversion: 2.1 time: 0.103347 May 23 16:53:03.488449 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 354/679] 10.222.0.74 () {58 vars in 1220 bytes} [Mon May 23 16:53:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1691468904 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:53:04.291561 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-31be2816-b096-4ba4-a56b-09cabccd364e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Action: 'create', calling method: .version_select at 0x7f224c31fb80>, body: {"keypair": {"name": "tempest-keypair-2110587716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRC5IWALxPe4W2zEqRwxinm4ahLv4ylcPu8zY3qbW3RcGmizSN/wbkTZ/zGzlzPxHH4yVh/VwXD0V9Q1fhgNE4UB0Ysvh6c8rhEbL1KAl+swY/RRCJes123+d0orCrNAw=="}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:53:04.306266 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-31be2816-b096-4ba4-a56b-09cabccd364e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Getting quotas for project c14a96662507495b84670e2f62f90f59. Resources: {'key_pairs'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:53:04.310043 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-31be2816-b096-4ba4-a56b-09cabccd364e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Getting quotas for user 0e90497b6d9c4a789f6b31680e069087 and project c14a96662507495b84670e2f62f90f59. Resources: {'key_pairs'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:53:04.385022 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-31be2816-b096-4ba4-a56b-09cabccd364e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.097466 May 23 16:53:04.385703 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 326/680] 10.222.0.74 () {60 vars in 1158 bytes} [Mon May 23 16:53:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:53:06.977398 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-b04b4518-24c0-4e1e-b0ae-b9263b057504 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-188981194", "imageRef": "96972e76-879d-4149-a713-a94529892aad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "947fccc6-85b5-4119-b9b2-40d0d2bd9aac"}], "security_groups": [{"name": "tempest-securitygroup--646512782"}], "key_name": "tempest-keypair-2110587716", "user_data": "}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:53:07.081263 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.network.neutron [None req-b04b4518-24c0-4e1e-b0ae-b9263b057504 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] validate_networks() for [('947fccc6-85b5-4119-b9b2-40d0d2bd9aac', None, None, None, None, None)] {{(pid=124715) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 16:53:07.443136 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-b04b4518-24c0-4e1e-b0ae-b9263b057504 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Flavor limits 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 16:53:07.443568 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-b04b4518-24c0-4e1e-b0ae-b9263b057504 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Image limits 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 16:53:07.444048 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-b04b4518-24c0-4e1e-b0ae-b9263b057504 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Flavor pref 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 16:53:07.444503 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-b04b4518-24c0-4e1e-b0ae-b9263b057504 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Image pref 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 16:53:07.444922 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-b04b4518-24c0-4e1e-b0ae-b9263b057504 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 16:53:07.454503 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b04b4518-24c0-4e1e-b0ae-b9263b057504 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:07.454947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b04b4518-24c0-4e1e-b0ae-b9263b057504 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:07.455742 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b04b4518-24c0-4e1e-b0ae-b9263b057504 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:07.456178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b04b4518-24c0-4e1e-b0ae-b9263b057504 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:07.472639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-b04b4518-24c0-4e1e-b0ae-b9263b057504 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Getting quotas for project c14a96662507495b84670e2f62f90f59. Resources: {'cores', 'instances', 'ram'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:53:07.476467 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-b04b4518-24c0-4e1e-b0ae-b9263b057504 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Getting quotas for user 0e90497b6d9c4a789f6b31680e069087 and project c14a96662507495b84670e2f62f90f59. Resources: {'cores', 'instances', 'ram'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:53:07.487107 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-b04b4518-24c0-4e1e-b0ae-b9263b057504 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Going to run 1 instances... {{(pid=124715) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 16:53:07.489397 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-b04b4518-24c0-4e1e-b0ae-b9263b057504 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96972e76-879d-4149-a713-a94529892aad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 16:53:07.620318 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-b04b4518-24c0-4e1e-b0ae-b9263b057504 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.647885 May 23 16:53:07.621111 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 355/681] 10.222.0.74 () {60 vars in 1146 bytes} [Mon May 23 16:53:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 16:53:07.631720 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-b45fbd4b-24a8-487e-999c-944671eb077c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:07.632575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-b45fbd4b-24a8-487e-999c-944671eb077c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:07.690715 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b45fbd4b-24a8-487e-999c-944671eb077c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:07.697403 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-b45fbd4b-24a8-487e-999c-944671eb077c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7" status: 200 len: 1237 microversion: 2.1 time: 0.069546 May 23 16:53:07.698092 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 327/682] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:07 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:08.715351 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-6a11bebd-3444-4708-ba56-d8eaee899524 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:08.716014 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-6a11bebd-3444-4708-ba56-d8eaee899524 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:08.725380 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a11bebd-3444-4708-ba56-d8eaee899524 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:08.725830 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a11bebd-3444-4708-ba56-d8eaee899524 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:08.726592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a11bebd-3444-4708-ba56-d8eaee899524 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:08.728085 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a11bebd-3444-4708-ba56-d8eaee899524 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:08.792118 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-6a11bebd-3444-4708-ba56-d8eaee899524 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:08.799917 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-6a11bebd-3444-4708-ba56-d8eaee899524 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7" status: 200 len: 1241 microversion: 2.1 time: 0.088912 May 23 16:53:08.800548 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 356/683] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:08 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:09.815904 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-44832590-1be0-4ff1-8447-2c3ccda59540 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:09.816585 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-44832590-1be0-4ff1-8447-2c3ccda59540 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:09.823126 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-44832590-1be0-4ff1-8447-2c3ccda59540 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:09.843270 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-44832590-1be0-4ff1-8447-2c3ccda59540 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:09.843270 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-44832590-1be0-4ff1-8447-2c3ccda59540 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:09.843270 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-44832590-1be0-4ff1-8447-2c3ccda59540 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:09.888617 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-44832590-1be0-4ff1-8447-2c3ccda59540 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:09.899386 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-44832590-1be0-4ff1-8447-2c3ccda59540 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7" status: 200 len: 1307 microversion: 2.1 time: 0.087212 May 23 16:53:09.899996 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 328/684] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:09 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 => generated 1307 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:10.917835 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-03672b00-14b0-460c-a7da-6cbd0336dd72 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:10.918454 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-03672b00-14b0-460c-a7da-6cbd0336dd72 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:10.925995 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-03672b00-14b0-460c-a7da-6cbd0336dd72 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:10.926477 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-03672b00-14b0-460c-a7da-6cbd0336dd72 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:10.927234 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-03672b00-14b0-460c-a7da-6cbd0336dd72 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:10.927678 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-03672b00-14b0-460c-a7da-6cbd0336dd72 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:11.092403 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-03672b00-14b0-460c-a7da-6cbd0336dd72 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:11.103501 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-03672b00-14b0-460c-a7da-6cbd0336dd72 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7" status: 200 len: 1362 microversion: 2.1 time: 0.189436 May 23 16:53:11.104612 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 357/685] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:10 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:11.268182 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-c8885b5c-36ce-42a3-bf6f-5a3f516d76f6 req-b8399e8d-f507-4b6b-a45a-f32764820af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de945e1d-3af8-44a5-a5e4-ece874d859d7", "tag": "56878ced-f382-4cec-8bad-fd66fd2ab2e9"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:53:11.276738 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-c8885b5c-36ce-42a3-bf6f-5a3f516d76f6 req-b8399e8d-f507-4b6b-a45a-f32764820af9 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:11.277189 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-c8885b5c-36ce-42a3-bf6f-5a3f516d76f6 req-b8399e8d-f507-4b6b-a45a-f32764820af9 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:11.290272 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-c8885b5c-36ce-42a3-bf6f-5a3f516d76f6 req-b8399e8d-f507-4b6b-a45a-f32764820af9 service nova] Creating event network-changed:56878ced-f382-4cec-8bad-fd66fd2ab2e9 for instance de945e1d-3af8-44a5-a5e4-ece874d859d7 on hv-cinder-83925 May 23 16:53:11.296954 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-c8885b5c-36ce-42a3-bf6f-5a3f516d76f6 req-b8399e8d-f507-4b6b-a45a-f32764820af9 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032483 May 23 16:53:11.298206 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 329/686] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:53:12.126637 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-750b085a-4483-4a6b-8b14-b32ab7ebf946 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:12.127246 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-750b085a-4483-4a6b-8b14-b32ab7ebf946 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:12.133698 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-750b085a-4483-4a6b-8b14-b32ab7ebf946 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:12.134150 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-750b085a-4483-4a6b-8b14-b32ab7ebf946 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:12.134910 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-750b085a-4483-4a6b-8b14-b32ab7ebf946 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:12.135346 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-750b085a-4483-4a6b-8b14-b32ab7ebf946 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:12.273920 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-750b085a-4483-4a6b-8b14-b32ab7ebf946 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:12.283155 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-750b085a-4483-4a6b-8b14-b32ab7ebf946 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7" status: 200 len: 1362 microversion: 2.1 time: 0.160159 May 23 16:53:12.283744 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 358/687] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:12 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:13.300785 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-e4a49ce5-6199-4752-aeb6-90adfaa30292 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:13.301498 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-e4a49ce5-6199-4752-aeb6-90adfaa30292 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:13.308158 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e4a49ce5-6199-4752-aeb6-90adfaa30292 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:13.308650 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e4a49ce5-6199-4752-aeb6-90adfaa30292 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:13.309428 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e4a49ce5-6199-4752-aeb6-90adfaa30292 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:13.310593 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e4a49ce5-6199-4752-aeb6-90adfaa30292 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:13.437826 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e4a49ce5-6199-4752-aeb6-90adfaa30292 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:13.445174 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-e4a49ce5-6199-4752-aeb6-90adfaa30292 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7" status: 200 len: 1362 microversion: 2.1 time: 0.148704 May 23 16:53:13.445748 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 330/688] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:13 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:14.461584 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-42fa677e-6d66-4cd7-bcf3-c55aed6d2325 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:14.462142 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-42fa677e-6d66-4cd7-bcf3-c55aed6d2325 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:14.469804 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-42fa677e-6d66-4cd7-bcf3-c55aed6d2325 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:14.470264 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-42fa677e-6d66-4cd7-bcf3-c55aed6d2325 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:14.471038 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-42fa677e-6d66-4cd7-bcf3-c55aed6d2325 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:14.471484 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-42fa677e-6d66-4cd7-bcf3-c55aed6d2325 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:14.597718 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-42fa677e-6d66-4cd7-bcf3-c55aed6d2325 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:14.605216 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-42fa677e-6d66-4cd7-bcf3-c55aed6d2325 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7" status: 200 len: 1362 microversion: 2.1 time: 0.147812 May 23 16:53:14.605820 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 359/689] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:14 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:15.622574 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-4e66581f-6363-4a1a-93e0-3dd82404c736 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:15.623188 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-4e66581f-6363-4a1a-93e0-3dd82404c736 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:15.629761 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4e66581f-6363-4a1a-93e0-3dd82404c736 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:15.630208 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4e66581f-6363-4a1a-93e0-3dd82404c736 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:15.630957 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4e66581f-6363-4a1a-93e0-3dd82404c736 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:15.631390 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4e66581f-6363-4a1a-93e0-3dd82404c736 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:15.760115 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-4e66581f-6363-4a1a-93e0-3dd82404c736 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:15.767467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-4e66581f-6363-4a1a-93e0-3dd82404c736 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7" status: 200 len: 1362 microversion: 2.1 time: 0.148849 May 23 16:53:15.768031 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 331/690] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:15 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:16.785121 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e30deeb7-c44b-4f87-a07a-22f2e5aaf818 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:16.785762 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e30deeb7-c44b-4f87-a07a-22f2e5aaf818 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:16.792209 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e30deeb7-c44b-4f87-a07a-22f2e5aaf818 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:16.792686 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e30deeb7-c44b-4f87-a07a-22f2e5aaf818 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:16.793447 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e30deeb7-c44b-4f87-a07a-22f2e5aaf818 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:16.793883 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e30deeb7-c44b-4f87-a07a-22f2e5aaf818 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:16.926168 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e30deeb7-c44b-4f87-a07a-22f2e5aaf818 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:16.934107 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e30deeb7-c44b-4f87-a07a-22f2e5aaf818 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7" status: 200 len: 1362 microversion: 2.1 time: 0.152599 May 23 16:53:16.935447 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 360/691] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:16 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:17.951875 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-f8174f66-2804-4026-8900-392fa42f7839 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:17.952532 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-f8174f66-2804-4026-8900-392fa42f7839 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:17.955242 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=6 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:53:17.960487 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f8174f66-2804-4026-8900-392fa42f7839 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:17.960986 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f8174f66-2804-4026-8900-392fa42f7839 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:17.961783 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f8174f66-2804-4026-8900-392fa42f7839 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:17.962225 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f8174f66-2804-4026-8900-392fa42f7839 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:18.102496 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-f8174f66-2804-4026-8900-392fa42f7839 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:18.113611 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-f8174f66-2804-4026-8900-392fa42f7839 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7" status: 200 len: 1362 microversion: 2.1 time: 0.164322 May 23 16:53:18.113611 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 332/692] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:17 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:18.975297 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-67800e84-d745-43e9-bbef-18c04515b7d5 req-4f10c90d-1dcb-4322-899e-7395169f9757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de945e1d-3af8-44a5-a5e4-ece874d859d7", "name": "network-vif-plugged", "status": "completed", "tag": "56878ced-f382-4cec-8bad-fd66fd2ab2e9"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:53:18.979801 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=2 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:53:18.980923 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=6 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:53:18.987171 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-67800e84-d745-43e9-bbef-18c04515b7d5 req-4f10c90d-1dcb-4322-899e-7395169f9757 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:18.987626 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-67800e84-d745-43e9-bbef-18c04515b7d5 req-4f10c90d-1dcb-4322-899e-7395169f9757 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:18.998968 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-67800e84-d745-43e9-bbef-18c04515b7d5 req-4f10c90d-1dcb-4322-899e-7395169f9757 service nova] Creating event network-vif-plugged:56878ced-f382-4cec-8bad-fd66fd2ab2e9 for instance de945e1d-3af8-44a5-a5e4-ece874d859d7 on hv-cinder-83925 May 23 16:53:19.003903 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-67800e84-d745-43e9-bbef-18c04515b7d5 req-4f10c90d-1dcb-4322-899e-7395169f9757 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032366 May 23 16:53:19.004844 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 361/693] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:53:19.128526 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-095ae4b6-713b-40dc-a514-7082c9fe474a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:19.129331 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-095ae4b6-713b-40dc-a514-7082c9fe474a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:19.135913 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-095ae4b6-713b-40dc-a514-7082c9fe474a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:19.136390 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-095ae4b6-713b-40dc-a514-7082c9fe474a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:19.137147 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-095ae4b6-713b-40dc-a514-7082c9fe474a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:19.137578 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-095ae4b6-713b-40dc-a514-7082c9fe474a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:19.270421 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-095ae4b6-713b-40dc-a514-7082c9fe474a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:19.277958 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-095ae4b6-713b-40dc-a514-7082c9fe474a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7" status: 200 len: 1362 microversion: 2.1 time: 0.153313 May 23 16:53:19.279037 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 333/694] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:19 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:20.299730 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-812da254-ab18-4f60-a558-ab46bdbe2461 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:20.301064 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-812da254-ab18-4f60-a558-ab46bdbe2461 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:20.313281 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-812da254-ab18-4f60-a558-ab46bdbe2461 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:20.313740 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-812da254-ab18-4f60-a558-ab46bdbe2461 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:20.314515 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-812da254-ab18-4f60-a558-ab46bdbe2461 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:20.314961 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-812da254-ab18-4f60-a558-ab46bdbe2461 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:20.454388 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-812da254-ab18-4f60-a558-ab46bdbe2461 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:20.462198 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-812da254-ab18-4f60-a558-ab46bdbe2461 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7" status: 200 len: 1362 microversion: 2.1 time: 0.170871 May 23 16:53:20.462762 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 362/695] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:20 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:21.478956 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-9e728327-7975-4812-89b5-ba3dc716b881 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:21.479508 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-9e728327-7975-4812-89b5-ba3dc716b881 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:21.486275 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9e728327-7975-4812-89b5-ba3dc716b881 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:21.486780 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9e728327-7975-4812-89b5-ba3dc716b881 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:21.487550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9e728327-7975-4812-89b5-ba3dc716b881 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:21.487993 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9e728327-7975-4812-89b5-ba3dc716b881 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:21.628791 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-9e728327-7975-4812-89b5-ba3dc716b881 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:21.636316 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-9e728327-7975-4812-89b5-ba3dc716b881 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7" status: 200 len: 1547 microversion: 2.1 time: 0.161223 May 23 16:53:21.636888 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 334/696] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:21 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:21.654156 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-f229f601-1c51-4850-8e10-09a0c5320600 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:21.654718 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-f229f601-1c51-4850-8e10-09a0c5320600 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:21.661277 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f229f601-1c51-4850-8e10-09a0c5320600 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:21.661729 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f229f601-1c51-4850-8e10-09a0c5320600 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:21.662499 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f229f601-1c51-4850-8e10-09a0c5320600 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:21.662940 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f229f601-1c51-4850-8e10-09a0c5320600 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:21.746145 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-f229f601-1c51-4850-8e10-09a0c5320600 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096488 May 23 16:53:21.746741 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 363/697] 10.222.0.74 () {58 vars in 1274 bytes} [Mon May 23 16:53:21 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:53:23.014206 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-a00d01bc-a5e5-49bf-83e5-776594f64f25 req-d6480e88-704b-4169-8f92-463cde6a79d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de945e1d-3af8-44a5-a5e4-ece874d859d7", "tag": "56878ced-f382-4cec-8bad-fd66fd2ab2e9"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:53:23.022655 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-a00d01bc-a5e5-49bf-83e5-776594f64f25 req-d6480e88-704b-4169-8f92-463cde6a79d4 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:23.028943 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-a00d01bc-a5e5-49bf-83e5-776594f64f25 req-d6480e88-704b-4169-8f92-463cde6a79d4 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:23.036992 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-a00d01bc-a5e5-49bf-83e5-776594f64f25 req-d6480e88-704b-4169-8f92-463cde6a79d4 service nova] Creating event network-changed:56878ced-f382-4cec-8bad-fd66fd2ab2e9 for instance de945e1d-3af8-44a5-a5e4-ece874d859d7 on hv-cinder-83925 May 23 16:53:23.042295 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-a00d01bc-a5e5-49bf-83e5-776594f64f25 req-d6480e88-704b-4169-8f92-463cde6a79d4 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032158 May 23 16:53:23.042913 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 335/698] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:53:29.162650 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-393aa7d5-b893-4460-be64-ff2b0bba6f9f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:29.163284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-393aa7d5-b893-4460-be64-ff2b0bba6f9f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:29.169330 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-393aa7d5-b893-4460-be64-ff2b0bba6f9f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:29.169810 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-393aa7d5-b893-4460-be64-ff2b0bba6f9f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:29.170578 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-393aa7d5-b893-4460-be64-ff2b0bba6f9f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:29.171014 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-393aa7d5-b893-4460-be64-ff2b0bba6f9f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:29.197354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-393aa7d5-b893-4460-be64-ff2b0bba6f9f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1/ips" status: 200 len: 149 microversion: 2.1 time: 0.039093 May 23 16:53:29.198224 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 364/699] 10.222.0.74 () {58 vars in 1247 bytes} [Mon May 23 16:53:29 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:53:30.796246 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-0336ae57-6137-4912-86e6-b4e04b0548a4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae109ada-c841-46dd-88bd-ae63cecc5e84"}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:53:30.797425 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-0336ae57-6137-4912-86e6-b4e04b0548a4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:30.802701 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:53:30.805048 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0336ae57-6137-4912-86e6-b4e04b0548a4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:30.808221 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0336ae57-6137-4912-86e6-b4e04b0548a4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:30.808221 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0336ae57-6137-4912-86e6-b4e04b0548a4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:30.808221 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0336ae57-6137-4912-86e6-b4e04b0548a4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:31.552279 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-0336ae57-6137-4912-86e6-b4e04b0548a4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "POST /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.761428 May 23 16:53:31.555759 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 336/700] 10.222.0.74 () {60 vars in 1322 bytes} [Mon May 23 16:53:30 2022] POST /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1/os-volume_attachments => generated 194 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:53:40.099741 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-82627a28-8def-43f9-83a1-2f20f64d44b5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae109ada-c841-46dd-88bd-ae63cecc5e84"}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:53:40.102415 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-82627a28-8def-43f9-83a1-2f20f64d44b5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:40.102899 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:53:40.103580 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:53:40.108542 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-82627a28-8def-43f9-83a1-2f20f64d44b5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:40.108993 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-82627a28-8def-43f9-83a1-2f20f64d44b5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:40.109750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-82627a28-8def-43f9-83a1-2f20f64d44b5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:40.110182 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-82627a28-8def-43f9-83a1-2f20f64d44b5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:40.188789 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-82627a28-8def-43f9-83a1-2f20f64d44b5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] HTTP exception thrown: Invalid volume: volume ae109ada-c841-46dd-88bd-ae63cecc5e84 is already attached to instances: 5df1e0c9-37f3-4752-9e82-553588ceb0b1 May 23 16:53:40.190519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-82627a28-8def-43f9-83a1-2f20f64d44b5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Request method failure captured: May 23 16:53:40.190519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: POST /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1/os-volume_attachments HTTP/1.1 May 23 16:53:40.190519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:53:40.190519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:53:40.190519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:53:40.190519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 74 May 23 16:53:40.190519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:53:40.190519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:53:40.190519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:53:40.190519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:53:40.190519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7oyo5VTSnwIFQPT0kTtFaHtIkHFj5L-FdhSIUmX9rttwLCW8jCAZ-X2qSMb7H2nHSgXjB6vWffoOpo-tnDcGctqzpOOjedHQxhH_K6_YUurOv1U6F0vB3iEbd4WjdXEZ7YlGpKqnMbRleSlAkItJeye3e1UHY4m4KuLnUpITA6zvao May 23 16:53:40.190519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:53:40.190519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:53:40.190519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:53:40.190519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:53:40.190519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:53:40.190519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:53:40.190519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:53:40.190519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:53:40.190519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:53:40.190519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:53:40.191879 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:53:40.191879 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:53:40.191879 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:53:40.191879 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:53:40.191879 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:53:40.191879 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:53:40.191879 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:53:40.191879 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: 718a82d2f4294f68965ce01aac0fc166 May 23 16:53:40.191879 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:53:40.191879 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: May 23 16:53:40.191879 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {"volumeAttachment": {"volumeId": "ae109ada-c841-46dd-88bd-ae63cecc5e84"}} May 23 16:53:40.191879 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 16:53:40.193379 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Invalid volume: volume ae109ada-c841-46dd-88bd-ae63cecc5e84 is already attached to instances: 5df1e0c9-37f3-4752-9e82-553588ceb0b1 May 23 16:53:40.193379 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'server_id': '5df1e0c9-37f3-4752-9e82-553588ceb0b1', 'body': {'volumeAttachment': {'volumeId': 'ae109ada-c841-46dd-88bd-ae63cecc5e84'}}} May 23 16:53:40.193379 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:53:40.193379 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:53:40.193379 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 16:53:40.193379 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 16:53:40.193379 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 16:53:40.193379 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 16:53:40.193379 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 16:53:40.193379 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 16:53:40.193379 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 23 16:53:40.193379 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 23 16:53:40.193379 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 23 16:53:40.193379 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 23 16:53:40.193379 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ae109ada-c841-46dd-88bd-ae63cecc5e84 is already attached to instances: 5df1e0c9-37f3-4752-9e82-553588ceb0b1 May 23 16:53:40.193379 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:53:40.193379 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:53:40.193379 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:53:40.193379 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:53:40.194882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:53:40.194882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:53:40.194882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:53:40.194882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:53:40.194882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:53:40.194882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:53:40.194882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 16:53:40.194882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 16:53:40.194882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 16:53:40.194882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 16:53:40.194882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 16:53:40.194882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 16:53:40.194882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 23 16:53:40.194882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 16:53:40.194882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ae109ada-c841-46dd-88bd-ae63cecc5e84 is already attached to instances: 5df1e0c9-37f3-4752-9e82-553588ceb0b1 May 23 16:53:40.194882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:53:40.194882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:53:40.194882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:53:40.194882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:53:40.194882 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:53:40.196794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:53:40.196794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:53:40.196794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:53:40.196794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ae109ada-c841-46dd-88bd-ae63cecc5e84 is already attached to instances: 5df1e0c9-37f3-4752-9e82-553588ceb0b1 May 23 16:53:40.196794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:53:40.196794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-82627a28-8def-43f9-83a1-2f20f64d44b5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Returning 400 to user: Invalid volume: volume ae109ada-c841-46dd-88bd-ae63cecc5e84 is already attached to instances: 5df1e0c9-37f3-4752-9e82-553588ceb0b1 {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:53:40.196794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-82627a28-8def-43f9-83a1-2f20f64d44b5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "POST /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096352 May 23 16:53:40.196794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 365/701] 10.222.0.74 () {60 vars in 1322 bytes} [Mon May 23 16:53:40 2022] POST /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 23 16:53:40.256113 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-898b6932-1201-4067-b97f-8259454d5118 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:40.256690 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-898b6932-1201-4067-b97f-8259454d5118 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:40.263614 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-898b6932-1201-4067-b97f-8259454d5118 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:40.264067 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-898b6932-1201-4067-b97f-8259454d5118 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:40.264935 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-898b6932-1201-4067-b97f-8259454d5118 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:40.265380 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-898b6932-1201-4067-b97f-8259454d5118 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:40.269279 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:53:40.345881 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.objects.instance [None req-898b6932-1201-4067-b97f-8259454d5118 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lazy-loading 'services' on Instance uuid 5df1e0c9-37f3-4752-9e82-553588ceb0b1 {{(pid=124714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:53:40.554469 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-898b6932-1201-4067-b97f-8259454d5118 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "DELETE /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1/os-volume_attachments/ae109ada-c841-46dd-88bd-ae63cecc5e84" status: 202 len: 0 microversion: 2.1 time: 0.302586 May 23 16:53:40.555076 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 337/702] 10.222.0.74 () {58 vars in 1415 bytes} [Mon May 23 16:53:40 2022] DELETE /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1/os-volume_attachments/ae109ada-c841-46dd-88bd-ae63cecc5e84 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:53:40.564462 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-85014802-df2c-4bba-92ac-be1502d13382 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:40.568442 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-85014802-df2c-4bba-92ac-be1502d13382 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:40.573191 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-85014802-df2c-4bba-92ac-be1502d13382 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:40.573652 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-85014802-df2c-4bba-92ac-be1502d13382 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:40.574462 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-85014802-df2c-4bba-92ac-be1502d13382 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:40.574907 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-85014802-df2c-4bba-92ac-be1502d13382 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:40.610381 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-85014802-df2c-4bba-92ac-be1502d13382 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050961 May 23 16:53:40.610929 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 366/703] 10.222.0.74 () {58 vars in 1301 bytes} [Mon May 23 16:53:40 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:53:41.623186 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-2e9e47c7-bee7-4e0c-b19d-93b029b15728 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:41.624252 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-2e9e47c7-bee7-4e0c-b19d-93b029b15728 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:41.630504 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2e9e47c7-bee7-4e0c-b19d-93b029b15728 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:41.630953 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2e9e47c7-bee7-4e0c-b19d-93b029b15728 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:41.631743 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2e9e47c7-bee7-4e0c-b19d-93b029b15728 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:41.632183 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2e9e47c7-bee7-4e0c-b19d-93b029b15728 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:41.661334 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-2e9e47c7-bee7-4e0c-b19d-93b029b15728 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043201 May 23 16:53:41.661886 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 338/704] 10.222.0.74 () {58 vars in 1301 bytes} [Mon May 23 16:53:41 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:53:42.672925 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-33b39102-8c66-45b3-84b1-45286b3b0110 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:42.673850 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-33b39102-8c66-45b3-84b1-45286b3b0110 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:42.680840 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-33b39102-8c66-45b3-84b1-45286b3b0110 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:42.681297 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-33b39102-8c66-45b3-84b1-45286b3b0110 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:42.682062 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-33b39102-8c66-45b3-84b1-45286b3b0110 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:42.682502 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-33b39102-8c66-45b3-84b1-45286b3b0110 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:42.711743 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-33b39102-8c66-45b3-84b1-45286b3b0110 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043437 May 23 16:53:42.712284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 367/705] 10.222.0.74 () {58 vars in 1301 bytes} [Mon May 23 16:53:42 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 16:53:42.770202 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-cb3da90a-a221-4856-ab48-c2cb461c9780 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:42.770720 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-cb3da90a-a221-4856-ab48-c2cb461c9780 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:42.777120 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cb3da90a-a221-4856-ab48-c2cb461c9780 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:42.777573 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cb3da90a-a221-4856-ab48-c2cb461c9780 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:42.778844 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cb3da90a-a221-4856-ab48-c2cb461c9780 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:42.779290 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cb3da90a-a221-4856-ab48-c2cb461c9780 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:42.803931 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-cb3da90a-a221-4856-ab48-c2cb461c9780 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Going to try to terminate instance {{(pid=124714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 16:53:43.041221 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-cb3da90a-a221-4856-ab48-c2cb461c9780 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "DELETE /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1" status: 204 len: 0 microversion: 2.1 time: 0.274520 May 23 16:53:43.041825 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 339/706] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 16:53:42 2022] DELETE /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 16:53:43.051024 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-2374ab12-1dbd-4345-bbc9-18adca7cad98 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:43.054096 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-2374ab12-1dbd-4345-bbc9-18adca7cad98 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:43.057935 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2374ab12-1dbd-4345-bbc9-18adca7cad98 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:43.058384 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2374ab12-1dbd-4345-bbc9-18adca7cad98 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:43.059167 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2374ab12-1dbd-4345-bbc9-18adca7cad98 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:43.060214 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2374ab12-1dbd-4345-bbc9-18adca7cad98 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:43.190484 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-2374ab12-1dbd-4345-bbc9-18adca7cad98 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:43.198073 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-2374ab12-1dbd-4345-bbc9-18adca7cad98 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1" status: 200 len: 1681 microversion: 2.1 time: 0.151239 May 23 16:53:43.198633 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 368/707] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:43 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:44.216842 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-4767ee95-c841-477b-8a73-cc70e358424d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:44.217595 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-4767ee95-c841-477b-8a73-cc70e358424d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:44.224418 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4767ee95-c841-477b-8a73-cc70e358424d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:44.227944 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4767ee95-c841-477b-8a73-cc70e358424d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:44.227944 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4767ee95-c841-477b-8a73-cc70e358424d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:44.227944 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4767ee95-c841-477b-8a73-cc70e358424d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:44.359715 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-4767ee95-c841-477b-8a73-cc70e358424d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:44.367235 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-4767ee95-c841-477b-8a73-cc70e358424d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1" status: 200 len: 1681 microversion: 2.1 time: 0.154885 May 23 16:53:44.367847 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 340/708] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:44 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:45.384957 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7eeb6f31-987c-43eb-976b-c48e5797278b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:45.390671 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-7eeb6f31-987c-43eb-976b-c48e5797278b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:45.393554 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7eeb6f31-987c-43eb-976b-c48e5797278b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:45.393971 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7eeb6f31-987c-43eb-976b-c48e5797278b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:45.394772 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7eeb6f31-987c-43eb-976b-c48e5797278b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:45.395205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7eeb6f31-987c-43eb-976b-c48e5797278b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:45.529513 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-7eeb6f31-987c-43eb-976b-c48e5797278b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:45.537239 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-7eeb6f31-987c-43eb-976b-c48e5797278b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1" status: 200 len: 1681 microversion: 2.1 time: 0.156231 May 23 16:53:45.537814 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 369/709] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:45 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:46.040503 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-f36182cb-b995-4f8b-a86c-ad5ef133b6c2 req-492798c0-da13-45f2-9e8e-3a89b8a2737e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5df1e0c9-37f3-4752-9e82-553588ceb0b1", "name": "network-vif-deleted", "tag": "f6effdfe-d86e-4a82-a12c-07ea95a8abf1"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:53:46.049235 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-f36182cb-b995-4f8b-a86c-ad5ef133b6c2 req-492798c0-da13-45f2-9e8e-3a89b8a2737e service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:46.050096 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-f36182cb-b995-4f8b-a86c-ad5ef133b6c2 req-492798c0-da13-45f2-9e8e-3a89b8a2737e service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:46.063248 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-f36182cb-b995-4f8b-a86c-ad5ef133b6c2 req-492798c0-da13-45f2-9e8e-3a89b8a2737e service nova] Creating event network-vif-deleted:f6effdfe-d86e-4a82-a12c-07ea95a8abf1 for instance 5df1e0c9-37f3-4752-9e82-553588ceb0b1 on hv-cinder-83925 May 23 16:53:46.068950 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-f36182cb-b995-4f8b-a86c-ad5ef133b6c2 req-492798c0-da13-45f2-9e8e-3a89b8a2737e service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032331 May 23 16:53:46.069561 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 341/710] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:53:46.555133 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-724a9ac3-ca9c-42b7-83fe-fd948e3096ea tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:46.555761 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-724a9ac3-ca9c-42b7-83fe-fd948e3096ea tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:46.565400 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-724a9ac3-ca9c-42b7-83fe-fd948e3096ea tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:46.565400 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-724a9ac3-ca9c-42b7-83fe-fd948e3096ea tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:46.565400 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-724a9ac3-ca9c-42b7-83fe-fd948e3096ea tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:46.565400 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-724a9ac3-ca9c-42b7-83fe-fd948e3096ea tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:46.599621 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-724a9ac3-ca9c-42b7-83fe-fd948e3096ea tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:46.600085 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-724a9ac3-ca9c-42b7-83fe-fd948e3096ea tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:46.600575 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.objects.instance [None req-724a9ac3-ca9c-42b7-83fe-fd948e3096ea tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lazy-loading 'fault' on Instance uuid 5df1e0c9-37f3-4752-9e82-553588ceb0b1 {{(pid=124715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:53:46.644998 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-724a9ac3-ca9c-42b7-83fe-fd948e3096ea tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:46.655351 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-724a9ac3-ca9c-42b7-83fe-fd948e3096ea tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1" status: 200 len: 1331 microversion: 2.1 time: 0.104313 May 23 16:53:46.656017 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 370/711] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:46 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:47.673263 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-bcbe01ec-144f-42fe-a79e-4102a9b1bc64 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:47.673966 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-bcbe01ec-144f-42fe-a79e-4102a9b1bc64 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:47.680662 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bcbe01ec-144f-42fe-a79e-4102a9b1bc64 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:47.681110 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bcbe01ec-144f-42fe-a79e-4102a9b1bc64 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:47.681866 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bcbe01ec-144f-42fe-a79e-4102a9b1bc64 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:47.682303 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bcbe01ec-144f-42fe-a79e-4102a9b1bc64 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:47.695599 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-bcbe01ec-144f-42fe-a79e-4102a9b1bc64 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] HTTP exception thrown: Instance 5df1e0c9-37f3-4752-9e82-553588ceb0b1 could not be found. May 23 16:53:47.697075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-bcbe01ec-144f-42fe-a79e-4102a9b1bc64 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Request method failure captured: May 23 16:53:47.697075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 HTTP/1.1 May 23 16:53:47.697075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:53:47.697075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:53:47.697075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:53:47.697075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 16:53:47.697075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:53:47.697075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:53:47.697075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:53:47.697075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:53:47.697075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7oyo5VTSnwIFQPT0kTtFaHtIkHFj5L-FdhSIUmX9rttwLCW8jCAZ-X2qSMb7H2nHSgXjB6vWffoOpo-tnDcGctqzpOOjedHQxhH_K6_YUurOv1U6F0vB3iEbd4WjdXEZ7YlGpKqnMbRleSlAkItJeye3e1UHY4m4KuLnUpITA6zvao May 23 16:53:47.697075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:53:47.697075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:53:47.697075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:53:47.697075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:53:47.697075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:53:47.697075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:53:47.697075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:53:47.697075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:53:47.697075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:53:47.697075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:53:47.698627 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:53:47.698627 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:53:47.698627 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:53:47.698627 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:53:47.698627 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:53:47.698627 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:53:47.698627 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:53:47.698627 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 718a82d2f4294f68965ce01aac0fc166 May 23 16:53:47.698627 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:53:47.698627 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: > May 23 16:53:47.698627 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Instance 5df1e0c9-37f3-4752-9e82-553588ceb0b1 could not be found. May 23 16:53:47.698627 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': '5df1e0c9-37f3-4752-9e82-553588ceb0b1'} May 23 16:53:47.699462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:53:47.699462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:53:47.699462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:53:47.699462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:53:47.699462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:53:47.699462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:53:47.699462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:53:47.699462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:53:47.699462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:53:47.699462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:53:47.699462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5df1e0c9-37f3-4752-9e82-553588ceb0b1 could not be found. May 23 16:53:47.699462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:53:47.699462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:53:47.699462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:53:47.699462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:53:47.699462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:53:47.699462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:53:47.699462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:53:47.699462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:53:47.699462 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:53:47.702109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:53:47.702109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:53:47.702109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:53:47.702109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:53:47.702109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:53:47.702109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:53:47.702109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:53:47.702109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5df1e0c9-37f3-4752-9e82-553588ceb0b1 could not be found. May 23 16:53:47.702109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:53:47.702109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:53:47.702109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:53:47.702109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:53:47.702109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:53:47.702109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:53:47.702109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:53:47.702109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:53:47.702109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5df1e0c9-37f3-4752-9e82-553588ceb0b1 could not be found. May 23 16:53:47.702109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:53:47.703450 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-bcbe01ec-144f-42fe-a79e-4102a9b1bc64 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Returning 404 to user: Instance 5df1e0c9-37f3-4752-9e82-553588ceb0b1 could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:53:47.703450 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-bcbe01ec-144f-42fe-a79e-4102a9b1bc64 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1" status: 404 len: 111 microversion: 2.1 time: 0.029497 May 23 16:53:47.703450 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 342/712] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:47 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:53:47.712209 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-341c7b54-4001-4e38-bad9-9b3bae646ca4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '.version_select at 0x7f224c444d30>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:47.797206 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-341c7b54-4001-4e38-bad9-9b3bae646ca4 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-165593506" status: 202 len: 0 microversion: 2.1 time: 0.089161 May 23 16:53:47.797776 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 371/713] 10.222.0.74 () {58 vars in 1217 bytes} [Mon May 23 16:53:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-165593506 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:53:48.544153 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ed03a6a1-32e7-42f4-b7cb-8f1ded2e1fce tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Action: 'create', calling method: .version_select at 0x7f224c3f5940>, body: {"keypair": {"name": "tempest-keypair-425189219", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUWuR0yHuc/Mic9JNaPjSm9FZdkV6cqwac/thIXnQ8mPwbxuNR37k6Qyx/Gnto1SBtMSY1gtQMUMAvsDI+jREu8bKxS/KFDY/PPMVP4rA1FL4M+8ZfjUyMesQqpBW2grQ=="}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:53:48.558225 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-ed03a6a1-32e7-42f4-b7cb-8f1ded2e1fce tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Getting quotas for project e293f2b3de9143ad9e8a1fe8b67d6641. Resources: {'key_pairs'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:53:48.563319 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-ed03a6a1-32e7-42f4-b7cb-8f1ded2e1fce tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Getting quotas for user 718a82d2f4294f68965ce01aac0fc166 and project e293f2b3de9143ad9e8a1fe8b67d6641. Resources: {'key_pairs'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:53:48.642340 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ed03a6a1-32e7-42f4-b7cb-8f1ded2e1fce tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.102137 May 23 16:53:48.642952 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 343/714] 10.222.0.74 () {60 vars in 1158 bytes} [Mon May 23 16:53:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:53:50.904587 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-72480f62-0624-4810-82e4-4bdf7b897331 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1518050319", "imageRef": "96972e76-879d-4149-a713-a94529892aad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18a683c4-5441-4a3c-96d0-ecf1b626575e"}], "security_groups": [{"name": "tempest-securitygroup--1208767760"}], "key_name": "tempest-keypair-425189219", "user_data": "}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:53:51.049026 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.network.neutron [None req-72480f62-0624-4810-82e4-4bdf7b897331 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] validate_networks() for [('18a683c4-5441-4a3c-96d0-ecf1b626575e', None, None, None, None, None)] {{(pid=124715) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 16:53:51.427872 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-72480f62-0624-4810-82e4-4bdf7b897331 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Flavor limits 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 16:53:51.428380 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-72480f62-0624-4810-82e4-4bdf7b897331 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Image limits 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 16:53:51.428870 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-72480f62-0624-4810-82e4-4bdf7b897331 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Flavor pref 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 16:53:51.429342 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-72480f62-0624-4810-82e4-4bdf7b897331 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Image pref 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 16:53:51.430657 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-72480f62-0624-4810-82e4-4bdf7b897331 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 16:53:51.438831 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-72480f62-0624-4810-82e4-4bdf7b897331 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:51.439288 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-72480f62-0624-4810-82e4-4bdf7b897331 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:51.440097 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-72480f62-0624-4810-82e4-4bdf7b897331 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:51.440576 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-72480f62-0624-4810-82e4-4bdf7b897331 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:51.458288 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-72480f62-0624-4810-82e4-4bdf7b897331 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Getting quotas for project e293f2b3de9143ad9e8a1fe8b67d6641. Resources: {'cores', 'instances', 'ram'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:53:51.462724 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-72480f62-0624-4810-82e4-4bdf7b897331 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Getting quotas for user 718a82d2f4294f68965ce01aac0fc166 and project e293f2b3de9143ad9e8a1fe8b67d6641. Resources: {'cores', 'instances', 'ram'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:53:51.474318 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-72480f62-0624-4810-82e4-4bdf7b897331 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Going to run 1 instances... {{(pid=124715) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 16:53:51.476657 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-72480f62-0624-4810-82e4-4bdf7b897331 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96972e76-879d-4149-a713-a94529892aad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 16:53:51.578153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-72480f62-0624-4810-82e4-4bdf7b897331 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.679169 May 23 16:53:51.580601 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 372/715] 10.222.0.74 () {60 vars in 1146 bytes} [Mon May 23 16:53:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 16:53:51.589170 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-799f567d-13f5-46f4-a426-7668061c926a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:51.589786 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-799f567d-13f5-46f4-a426-7668061c926a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:51.666917 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-799f567d-13f5-46f4-a426-7668061c926a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:51.681056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-799f567d-13f5-46f4-a426-7668061c926a tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 200 len: 1241 microversion: 2.1 time: 0.090925 May 23 16:53:51.681056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 344/716] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:51 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:52.229870 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-ed826734-5f03-4005-8244-500f3d0e36c1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:52.230380 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-ed826734-5f03-4005-8244-500f3d0e36c1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:52.242054 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ed826734-5f03-4005-8244-500f3d0e36c1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:52.242054 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ed826734-5f03-4005-8244-500f3d0e36c1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:52.242054 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ed826734-5f03-4005-8244-500f3d0e36c1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:52.242054 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ed826734-5f03-4005-8244-500f3d0e36c1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:52.264581 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-ed826734-5f03-4005-8244-500f3d0e36c1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af/ips" status: 200 len: 151 microversion: 2.20 time: 0.038619 May 23 16:53:52.265246 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 373/717] 10.222.0.74 () {60 vars in 1288 bytes} [Mon May 23 16:53:52 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 16:53:52.696749 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-c44242e4-cd6a-4739-9745-94183d6a91bc tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:52.697405 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-c44242e4-cd6a-4739-9745-94183d6a91bc tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:52.704995 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c44242e4-cd6a-4739-9745-94183d6a91bc tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:52.705452 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c44242e4-cd6a-4739-9745-94183d6a91bc tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:52.706227 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c44242e4-cd6a-4739-9745-94183d6a91bc tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:52.706672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c44242e4-cd6a-4739-9745-94183d6a91bc tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:52.776114 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-c44242e4-cd6a-4739-9745-94183d6a91bc tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:52.785025 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-c44242e4-cd6a-4739-9745-94183d6a91bc tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 200 len: 1245 microversion: 2.1 time: 0.092101 May 23 16:53:52.785614 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 345/718] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:52 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:53.802395 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-bb4a2255-df50-4fe3-8ce0-1a3cb42aff82 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:53.803017 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-bb4a2255-df50-4fe3-8ce0-1a3cb42aff82 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:53.810133 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bb4a2255-df50-4fe3-8ce0-1a3cb42aff82 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:53.810604 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bb4a2255-df50-4fe3-8ce0-1a3cb42aff82 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:53.811391 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bb4a2255-df50-4fe3-8ce0-1a3cb42aff82 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:53.811838 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bb4a2255-df50-4fe3-8ce0-1a3cb42aff82 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:53.877981 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-bb4a2255-df50-4fe3-8ce0-1a3cb42aff82 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:53.886544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-bb4a2255-df50-4fe3-8ce0-1a3cb42aff82 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 200 len: 1311 microversion: 2.1 time: 0.088228 May 23 16:53:53.887110 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 374/719] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:53 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 1311 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:54.414118 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ed837b72-7d11-4ce2-976c-fc8b51dd05ad tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:53:54.414807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ed837b72-7d11-4ce2-976c-fc8b51dd05ad tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:54.423587 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ed837b72-7d11-4ce2-976c-fc8b51dd05ad tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:54.424172 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ed837b72-7d11-4ce2-976c-fc8b51dd05ad tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:54.425088 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ed837b72-7d11-4ce2-976c-fc8b51dd05ad tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:54.425601 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ed837b72-7d11-4ce2-976c-fc8b51dd05ad tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:54.451428 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.objects.instance [None req-ed837b72-7d11-4ce2-976c-fc8b51dd05ad tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lazy-loading 'flavor' on Instance uuid fa18b171-8b37-4fcc-b7e9-e50494e967af {{(pid=124714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:53:54.905568 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-d533f50a-c0f0-4738-a2e1-84a49090b7f5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:54.906947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-d533f50a-c0f0-4738-a2e1-84a49090b7f5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:54.913997 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d533f50a-c0f0-4738-a2e1-84a49090b7f5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:54.914547 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d533f50a-c0f0-4738-a2e1-84a49090b7f5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:54.915574 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d533f50a-c0f0-4738-a2e1-84a49090b7f5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:54.916109 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d533f50a-c0f0-4738-a2e1-84a49090b7f5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:55.077966 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d533f50a-c0f0-4738-a2e1-84a49090b7f5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:55.089275 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ed837b72-7d11-4ce2-976c-fc8b51dd05ad tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "POST /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af/action" status: 202 len: 0 microversion: 2.20 time: 0.678571 May 23 16:53:55.094950 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 346/720] 10.222.0.74 () {62 vars in 1318 bytes} [Mon May 23 16:53:54 2022] POST /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af/action => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 16:53:55.098782 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-d533f50a-c0f0-4738-a2e1-84a49090b7f5 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 200 len: 1367 microversion: 2.1 time: 0.197314 May 23 16:53:55.099709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 375/721] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:54 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:53:55.119648 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-dea02b53-a837-49a6-b4f6-bf7cd2ca4be4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:55.121198 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-dea02b53-a837-49a6-b4f6-bf7cd2ca4be4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:55.130232 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dea02b53-a837-49a6-b4f6-bf7cd2ca4be4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:55.130928 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dea02b53-a837-49a6-b4f6-bf7cd2ca4be4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:55.131772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dea02b53-a837-49a6-b4f6-bf7cd2ca4be4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:55.132503 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dea02b53-a837-49a6-b4f6-bf7cd2ca4be4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:55.279268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-dea02b53-a837-49a6-b4f6-bf7cd2ca4be4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:55.287372 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-dea02b53-a837-49a6-b4f6-bf7cd2ca4be4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:55.288948 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-dea02b53-a837-49a6-b4f6-bf7cd2ca4be4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:55.290108 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-dea02b53-a837-49a6-b4f6-bf7cd2ca4be4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1721 microversion: 2.20 time: 0.192615 May 23 16:53:55.292438 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 347/722] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:53:55 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:53:55.646311 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-97137b84-fe92-4015-9d89-dec0657d6ea5 req-01aff937-25d6-4ed5-aa97-28ea21e22f64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4b22328-963e-4a51-8ace-087e5b74cb2f", "tag": "a163250d-cd50-475a-b6a2-fbdd4207e65f"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:53:55.654617 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-97137b84-fe92-4015-9d89-dec0657d6ea5 req-01aff937-25d6-4ed5-aa97-28ea21e22f64 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:55.655099 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-97137b84-fe92-4015-9d89-dec0657d6ea5 req-01aff937-25d6-4ed5-aa97-28ea21e22f64 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:55.673080 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-97137b84-fe92-4015-9d89-dec0657d6ea5 req-01aff937-25d6-4ed5-aa97-28ea21e22f64 service nova] Creating event network-changed:a163250d-cd50-475a-b6a2-fbdd4207e65f for instance f4b22328-963e-4a51-8ace-087e5b74cb2f on hv-cinder-83925 May 23 16:53:55.678521 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-97137b84-fe92-4015-9d89-dec0657d6ea5 req-01aff937-25d6-4ed5-aa97-28ea21e22f64 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035796 May 23 16:53:55.679132 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 376/723] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:53:56.122489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-e68ed498-400b-4a80-bf8c-4a8b1ded132f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:56.123401 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-e68ed498-400b-4a80-bf8c-4a8b1ded132f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:56.130088 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e68ed498-400b-4a80-bf8c-4a8b1ded132f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:56.130481 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e68ed498-400b-4a80-bf8c-4a8b1ded132f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:56.131243 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e68ed498-400b-4a80-bf8c-4a8b1ded132f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:56.131678 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e68ed498-400b-4a80-bf8c-4a8b1ded132f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:56.311931 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-cfe7b0ea-7d7b-4103-9ec6-6b8c9151b187 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:56.312843 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-cfe7b0ea-7d7b-4103-9ec6-6b8c9151b187 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:56.320269 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cfe7b0ea-7d7b-4103-9ec6-6b8c9151b187 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:56.321303 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cfe7b0ea-7d7b-4103-9ec6-6b8c9151b187 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:56.322083 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cfe7b0ea-7d7b-4103-9ec6-6b8c9151b187 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:56.322519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cfe7b0ea-7d7b-4103-9ec6-6b8c9151b187 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:56.499828 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e68ed498-400b-4a80-bf8c-4a8b1ded132f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:56.506924 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-cfe7b0ea-7d7b-4103-9ec6-6b8c9151b187 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:56.519106 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-e68ed498-400b-4a80-bf8c-4a8b1ded132f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 200 len: 1367 microversion: 2.1 time: 0.389492 May 23 16:53:56.519106 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 348/724] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:56 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 1367 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:56.519352 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-cfe7b0ea-7d7b-4103-9ec6-6b8c9151b187 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:56.519352 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-cfe7b0ea-7d7b-4103-9ec6-6b8c9151b187 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:56.520489 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-cfe7b0ea-7d7b-4103-9ec6-6b8c9151b187 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1721 microversion: 2.20 time: 0.215268 May 23 16:53:56.521100 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 377/725] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:53:56 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:53:57.527036 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-761739ad-4065-46ff-a598-ed9339ecdfbd tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:57.527658 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-761739ad-4065-46ff-a598-ed9339ecdfbd tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:57.535117 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-761739ad-4065-46ff-a598-ed9339ecdfbd tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:57.535646 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-761739ad-4065-46ff-a598-ed9339ecdfbd tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:57.537055 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-761739ad-4065-46ff-a598-ed9339ecdfbd tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:57.537620 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-761739ad-4065-46ff-a598-ed9339ecdfbd tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:57.538825 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-ed4bdc97-f590-42a5-9542-7a7c47dc813d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:57.539459 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-ed4bdc97-f590-42a5-9542-7a7c47dc813d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:57.546950 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ed4bdc97-f590-42a5-9542-7a7c47dc813d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:57.547408 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ed4bdc97-f590-42a5-9542-7a7c47dc813d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:57.548194 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ed4bdc97-f590-42a5-9542-7a7c47dc813d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:57.548669 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ed4bdc97-f590-42a5-9542-7a7c47dc813d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:57.763769 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-761739ad-4065-46ff-a598-ed9339ecdfbd tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:57.770784 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-ed4bdc97-f590-42a5-9542-7a7c47dc813d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:57.772995 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-761739ad-4065-46ff-a598-ed9339ecdfbd tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 200 len: 1367 microversion: 2.1 time: 0.251029 May 23 16:53:57.773781 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 349/726] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:57 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:57.779617 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-ed4bdc97-f590-42a5-9542-7a7c47dc813d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:57.781191 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-ed4bdc97-f590-42a5-9542-7a7c47dc813d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:57.782440 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-ed4bdc97-f590-42a5-9542-7a7c47dc813d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1721 microversion: 2.20 time: 0.247434 May 23 16:53:57.783098 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 378/727] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:53:57 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:53:58.789970 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-4e0285d8-438d-443b-985d-018b969c66d7 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:58.790594 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-4e0285d8-438d-443b-985d-018b969c66d7 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:58.800504 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-25d2e0cc-f126-496c-a761-d53a4910fe32 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:53:58.801753 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-25d2e0cc-f126-496c-a761-d53a4910fe32 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:53:58.805274 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4e0285d8-438d-443b-985d-018b969c66d7 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:58.805764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4e0285d8-438d-443b-985d-018b969c66d7 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:58.806552 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4e0285d8-438d-443b-985d-018b969c66d7 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:58.806995 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4e0285d8-438d-443b-985d-018b969c66d7 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:58.808431 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-25d2e0cc-f126-496c-a761-d53a4910fe32 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:58.808885 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-25d2e0cc-f126-496c-a761-d53a4910fe32 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:58.811110 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-25d2e0cc-f126-496c-a761-d53a4910fe32 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:53:58.811545 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-25d2e0cc-f126-496c-a761-d53a4910fe32 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:53:59.014444 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-4e0285d8-438d-443b-985d-018b969c66d7 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:59.017642 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-25d2e0cc-f126-496c-a761-d53a4910fe32 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:59.022036 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-4e0285d8-438d-443b-985d-018b969c66d7 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 200 len: 1367 microversion: 2.1 time: 0.235964 May 23 16:53:59.022603 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 350/728] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:53:58 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:53:59.027624 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-25d2e0cc-f126-496c-a761-d53a4910fe32 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:59.029884 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-25d2e0cc-f126-496c-a761-d53a4910fe32 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:53:59.031051 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-25d2e0cc-f126-496c-a761-d53a4910fe32 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1721 microversion: 2.20 time: 0.234571 May 23 16:53:59.031760 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 379/729] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:53:58 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:54:00.040546 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-5bd94e26-936f-4a1e-b6d2-a6a31251dd8f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:00.041168 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-5bd94e26-936f-4a1e-b6d2-a6a31251dd8f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:00.048655 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-5bd94e26-936f-4a1e-b6d2-a6a31251dd8f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:00.048948 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-5bd94e26-936f-4a1e-b6d2-a6a31251dd8f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:00.049144 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-06d2bab2-42fb-4ac1-9bec-79a49d9e6402 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:00.049785 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-06d2bab2-42fb-4ac1-9bec-79a49d9e6402 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:00.049888 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-5bd94e26-936f-4a1e-b6d2-a6a31251dd8f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:00.050129 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-5bd94e26-936f-4a1e-b6d2-a6a31251dd8f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:00.056550 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-06d2bab2-42fb-4ac1-9bec-79a49d9e6402 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:00.056889 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-06d2bab2-42fb-4ac1-9bec-79a49d9e6402 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:00.057646 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-06d2bab2-42fb-4ac1-9bec-79a49d9e6402 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:00.058080 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-06d2bab2-42fb-4ac1-9bec-79a49d9e6402 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:00.253573 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-5bd94e26-936f-4a1e-b6d2-a6a31251dd8f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:00.260340 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-06d2bab2-42fb-4ac1-9bec-79a49d9e6402 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:00.260994 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-5bd94e26-936f-4a1e-b6d2-a6a31251dd8f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 200 len: 1367 microversion: 2.1 time: 0.224366 May 23 16:54:00.261564 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 351/730] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:54:00 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:54:00.269270 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-06d2bab2-42fb-4ac1-9bec-79a49d9e6402 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:00.270870 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-06d2bab2-42fb-4ac1-9bec-79a49d9e6402 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:00.272203 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-06d2bab2-42fb-4ac1-9bec-79a49d9e6402 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1721 microversion: 2.20 time: 0.226884 May 23 16:54:00.272578 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 380/731] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:00 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:54:01.279052 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-b9ddb446-2764-47d2-9761-2a36fc497814 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:01.279698 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-b9ddb446-2764-47d2-9761-2a36fc497814 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:01.282083 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:01.286784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b9ddb446-2764-47d2-9761-2a36fc497814 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:01.287332 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b9ddb446-2764-47d2-9761-2a36fc497814 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:01.287977 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b9ddb446-2764-47d2-9761-2a36fc497814 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:01.288550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b9ddb446-2764-47d2-9761-2a36fc497814 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:01.292337 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-bc0b30a3-2616-4c1d-8768-54dd837cda5a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:01.292963 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-bc0b30a3-2616-4c1d-8768-54dd837cda5a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:01.300711 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bc0b30a3-2616-4c1d-8768-54dd837cda5a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:01.301175 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bc0b30a3-2616-4c1d-8768-54dd837cda5a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:01.301960 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bc0b30a3-2616-4c1d-8768-54dd837cda5a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:01.302405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-bc0b30a3-2616-4c1d-8768-54dd837cda5a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:01.448468 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=2 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:01.470336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=6 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:01.488123 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b9ddb446-2764-47d2-9761-2a36fc497814 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:01.490380 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:01.494873 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-bc0b30a3-2616-4c1d-8768-54dd837cda5a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:01.496530 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-b9ddb446-2764-47d2-9761-2a36fc497814 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 200 len: 1367 microversion: 2.1 time: 0.221724 May 23 16:54:01.497267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 352/732] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:54:01 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:54:01.503217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-bc0b30a3-2616-4c1d-8768-54dd837cda5a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:01.504758 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-bc0b30a3-2616-4c1d-8768-54dd837cda5a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:01.506050 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-bc0b30a3-2616-4c1d-8768-54dd837cda5a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1721 microversion: 2.20 time: 0.217630 May 23 16:54:01.507781 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 381/733] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:01 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:54:02.513906 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-a99fc21f-6b86-4c55-b0cf-e36280471338 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:02.514527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-a99fc21f-6b86-4c55-b0cf-e36280471338 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:02.517003 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=6 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:02.522953 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a99fc21f-6b86-4c55-b0cf-e36280471338 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:02.523408 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a99fc21f-6b86-4c55-b0cf-e36280471338 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:02.524181 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a99fc21f-6b86-4c55-b0cf-e36280471338 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:02.524686 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a99fc21f-6b86-4c55-b0cf-e36280471338 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:02.530256 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a429d9db-45bb-4dab-bd59-52233a5683e4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:02.530886 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a429d9db-45bb-4dab-bd59-52233a5683e4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:02.537717 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a429d9db-45bb-4dab-bd59-52233a5683e4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:02.538212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a429d9db-45bb-4dab-bd59-52233a5683e4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:02.538991 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a429d9db-45bb-4dab-bd59-52233a5683e4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:02.539433 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a429d9db-45bb-4dab-bd59-52233a5683e4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:02.732255 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-a99fc21f-6b86-4c55-b0cf-e36280471338 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:02.735845 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a429d9db-45bb-4dab-bd59-52233a5683e4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:02.739697 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-a99fc21f-6b86-4c55-b0cf-e36280471338 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 200 len: 1367 microversion: 2.1 time: 0.230185 May 23 16:54:02.740271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 353/734] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:54:02 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:54:02.743803 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a429d9db-45bb-4dab-bd59-52233a5683e4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:02.745360 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a429d9db-45bb-4dab-bd59-52233a5683e4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:02.747003 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a429d9db-45bb-4dab-bd59-52233a5683e4 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1721 microversion: 2.20 time: 0.222369 May 23 16:54:02.747811 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 382/735] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:02 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:54:03.758120 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-a3e63780-29cf-4131-a9a6-4f262e30e9f1 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:03.758733 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-a3e63780-29cf-4131-a9a6-4f262e30e9f1 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:03.764968 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a3e63780-29cf-4131-a9a6-4f262e30e9f1 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:03.765246 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-88ca7740-967f-47cc-a916-8b391d7f5d09 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:03.765703 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a3e63780-29cf-4131-a9a6-4f262e30e9f1 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:03.765863 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-88ca7740-967f-47cc-a916-8b391d7f5d09 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:03.766159 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a3e63780-29cf-4131-a9a6-4f262e30e9f1 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:03.766597 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a3e63780-29cf-4131-a9a6-4f262e30e9f1 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:03.772268 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-88ca7740-967f-47cc-a916-8b391d7f5d09 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:03.772753 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-88ca7740-967f-47cc-a916-8b391d7f5d09 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:03.773537 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-88ca7740-967f-47cc-a916-8b391d7f5d09 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:03.773959 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-88ca7740-967f-47cc-a916-8b391d7f5d09 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:03.963865 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-a3e63780-29cf-4131-a9a6-4f262e30e9f1 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:03.968538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-88ca7740-967f-47cc-a916-8b391d7f5d09 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:03.971975 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=100 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:03.972764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-a3e63780-29cf-4131-a9a6-4f262e30e9f1 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 200 len: 1367 microversion: 2.1 time: 0.219389 May 23 16:54:03.973320 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 354/736] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:54:03 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:54:03.976901 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-88ca7740-967f-47cc-a916-8b391d7f5d09 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:03.978428 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-88ca7740-967f-47cc-a916-8b391d7f5d09 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:03.979586 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-88ca7740-967f-47cc-a916-8b391d7f5d09 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1721 microversion: 2.20 time: 0.218548 May 23 16:54:03.980128 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 383/737] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:03 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:54:04.989795 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ea7142f3-a74b-4ce2-a179-12b1e1b32f53 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:04.990333 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ea7142f3-a74b-4ce2-a179-12b1e1b32f53 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:04.997840 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ea7142f3-a74b-4ce2-a179-12b1e1b32f53 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:04.998111 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-937f3870-e2c1-4cdc-b26f-7a0744a7c1d2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:04.998549 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ea7142f3-a74b-4ce2-a179-12b1e1b32f53 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:04.998721 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-937f3870-e2c1-4cdc-b26f-7a0744a7c1d2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:04.999057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ea7142f3-a74b-4ce2-a179-12b1e1b32f53 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:04.999500 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ea7142f3-a74b-4ce2-a179-12b1e1b32f53 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:05.005251 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-937f3870-e2c1-4cdc-b26f-7a0744a7c1d2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:05.005692 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-937f3870-e2c1-4cdc-b26f-7a0744a7c1d2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:05.006456 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-937f3870-e2c1-4cdc-b26f-7a0744a7c1d2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:05.006922 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-937f3870-e2c1-4cdc-b26f-7a0744a7c1d2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:05.193108 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ea7142f3-a74b-4ce2-a179-12b1e1b32f53 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:05.201065 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-937f3870-e2c1-4cdc-b26f-7a0744a7c1d2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:05.202840 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ea7142f3-a74b-4ce2-a179-12b1e1b32f53 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 200 len: 1367 microversion: 2.1 time: 0.216945 May 23 16:54:05.203465 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 355/738] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:54:04 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:54:05.209381 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-937f3870-e2c1-4cdc-b26f-7a0744a7c1d2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:05.211097 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-937f3870-e2c1-4cdc-b26f-7a0744a7c1d2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:05.212375 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-937f3870-e2c1-4cdc-b26f-7a0744a7c1d2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1721 microversion: 2.20 time: 0.218824 May 23 16:54:05.213249 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 384/739] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:04 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:54:06.220656 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-848d879d-42f8-40c5-9fc0-2d4e0a9e4cda tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:06.221285 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-848d879d-42f8-40c5-9fc0-2d4e0a9e4cda tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:06.228103 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-848d879d-42f8-40c5-9fc0-2d4e0a9e4cda tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:06.228595 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-848d879d-42f8-40c5-9fc0-2d4e0a9e4cda tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:06.229373 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-848d879d-42f8-40c5-9fc0-2d4e0a9e4cda tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:06.229821 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-848d879d-42f8-40c5-9fc0-2d4e0a9e4cda tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:06.231420 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-dbef882f-36b3-4360-a9c2-dedb553ff60e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:06.232132 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-dbef882f-36b3-4360-a9c2-dedb553ff60e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:06.238580 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dbef882f-36b3-4360-a9c2-dedb553ff60e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:06.239028 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dbef882f-36b3-4360-a9c2-dedb553ff60e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:06.239799 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dbef882f-36b3-4360-a9c2-dedb553ff60e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:06.240234 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dbef882f-36b3-4360-a9c2-dedb553ff60e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:06.432480 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-848d879d-42f8-40c5-9fc0-2d4e0a9e4cda tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:06.436822 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-dbef882f-36b3-4360-a9c2-dedb553ff60e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:06.442107 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-848d879d-42f8-40c5-9fc0-2d4e0a9e4cda tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 200 len: 1367 microversion: 2.1 time: 0.225406 May 23 16:54:06.442700 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 356/740] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:54:06 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:54:06.446429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-dbef882f-36b3-4360-a9c2-dedb553ff60e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:06.448016 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-dbef882f-36b3-4360-a9c2-dedb553ff60e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:06.449388 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-dbef882f-36b3-4360-a9c2-dedb553ff60e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1721 microversion: 2.20 time: 0.222410 May 23 16:54:06.454618 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 385/741] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:06 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:54:07.457319 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-e1cd256f-9f26-4506-b5d0-01d01c21c702 req-21adb218-72f3-402c-ae9a-da5919eb7ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4b22328-963e-4a51-8ace-087e5b74cb2f", "name": "network-vif-plugged", "status": "completed", "tag": "a163250d-cd50-475a-b6a2-fbdd4207e65f"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:54:07.458707 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-4954ce40-f70c-4825-8153-81b10682f532 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:07.459583 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-4954ce40-f70c-4825-8153-81b10682f532 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:07.473214 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4954ce40-f70c-4825-8153-81b10682f532 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:07.473408 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-e1cd256f-9f26-4506-b5d0-01d01c21c702 req-21adb218-72f3-402c-ae9a-da5919eb7ae3 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:07.473551 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4954ce40-f70c-4825-8153-81b10682f532 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:07.473655 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-e1cd256f-9f26-4506-b5d0-01d01c21c702 req-21adb218-72f3-402c-ae9a-da5919eb7ae3 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:07.473744 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4954ce40-f70c-4825-8153-81b10682f532 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:07.473744 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4954ce40-f70c-4825-8153-81b10682f532 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:07.478798 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-e1cd256f-9f26-4506-b5d0-01d01c21c702 req-21adb218-72f3-402c-ae9a-da5919eb7ae3 service nova] Creating event network-vif-plugged:a163250d-cd50-475a-b6a2-fbdd4207e65f for instance f4b22328-963e-4a51-8ace-087e5b74cb2f on hv-cinder-83925 May 23 16:54:07.485014 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-e1cd256f-9f26-4506-b5d0-01d01c21c702 req-21adb218-72f3-402c-ae9a-da5919eb7ae3 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035571 May 23 16:54:07.485621 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 357/742] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:54:07.493656 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-473cb351-c22a-4808-ab71-5d7f3fca2bd6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:07.494352 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-473cb351-c22a-4808-ab71-5d7f3fca2bd6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:07.501372 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-473cb351-c22a-4808-ab71-5d7f3fca2bd6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:07.502134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-473cb351-c22a-4808-ab71-5d7f3fca2bd6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:07.502928 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-473cb351-c22a-4808-ab71-5d7f3fca2bd6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:07.503380 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-473cb351-c22a-4808-ab71-5d7f3fca2bd6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:07.663248 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-4954ce40-f70c-4825-8153-81b10682f532 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:07.671341 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-4954ce40-f70c-4825-8153-81b10682f532 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 200 len: 1367 microversion: 2.1 time: 0.216387 May 23 16:54:07.671906 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 386/743] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:54:07 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:54:07.689160 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-473cb351-c22a-4808-ab71-5d7f3fca2bd6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:07.697148 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-473cb351-c22a-4808-ab71-5d7f3fca2bd6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:07.698670 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-473cb351-c22a-4808-ab71-5d7f3fca2bd6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:07.700442 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-473cb351-c22a-4808-ab71-5d7f3fca2bd6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1721 microversion: 2.20 time: 0.210343 May 23 16:54:07.701008 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 358/744] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:07 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:07.902578 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 16:54:07.903355 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Mon May 23 16:54:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 16:54:08.688460 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-25ec424f-1a57-4a58-8949-1244a3e428e3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:08.689112 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-25ec424f-1a57-4a58-8949-1244a3e428e3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:08.695564 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-25ec424f-1a57-4a58-8949-1244a3e428e3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:08.696016 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-25ec424f-1a57-4a58-8949-1244a3e428e3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:08.696819 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-25ec424f-1a57-4a58-8949-1244a3e428e3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:08.697260 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-25ec424f-1a57-4a58-8949-1244a3e428e3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:08.719511 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-56aeb33c-591f-4f8e-abdf-a45a286706cf tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:08.720124 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-56aeb33c-591f-4f8e-abdf-a45a286706cf tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:08.727108 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-56aeb33c-591f-4f8e-abdf-a45a286706cf tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:08.727564 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-56aeb33c-591f-4f8e-abdf-a45a286706cf tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:08.728346 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-56aeb33c-591f-4f8e-abdf-a45a286706cf tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:08.728785 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-56aeb33c-591f-4f8e-abdf-a45a286706cf tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:08.892635 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-25ec424f-1a57-4a58-8949-1244a3e428e3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:08.900124 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-25ec424f-1a57-4a58-8949-1244a3e428e3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 200 len: 1367 microversion: 2.1 time: 0.215585 May 23 16:54:08.900738 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 387/745] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:54:08 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:54:08.906147 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-56aeb33c-591f-4f8e-abdf-a45a286706cf tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:08.914219 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-56aeb33c-591f-4f8e-abdf-a45a286706cf tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:08.915741 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-56aeb33c-591f-4f8e-abdf-a45a286706cf tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:08.916953 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-56aeb33c-591f-4f8e-abdf-a45a286706cf tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1721 microversion: 2.20 time: 0.202137 May 23 16:54:08.917505 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 359/746] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:08 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:54:09.917335 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7fe382ca-46d0-465b-80e3-1925fcb6bd2f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:09.926578 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-7fe382ca-46d0-465b-80e3-1925fcb6bd2f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:09.926578 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7fe382ca-46d0-465b-80e3-1925fcb6bd2f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:09.926578 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7fe382ca-46d0-465b-80e3-1925fcb6bd2f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:09.926578 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7fe382ca-46d0-465b-80e3-1925fcb6bd2f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:09.927565 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7fe382ca-46d0-465b-80e3-1925fcb6bd2f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:09.935190 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-9b8e73f1-e71e-4464-83f6-6436a8a72daa tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:09.935799 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-9b8e73f1-e71e-4464-83f6-6436a8a72daa tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:09.942384 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9b8e73f1-e71e-4464-83f6-6436a8a72daa tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:09.942834 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9b8e73f1-e71e-4464-83f6-6436a8a72daa tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:09.943597 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9b8e73f1-e71e-4464-83f6-6436a8a72daa tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:09.944037 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9b8e73f1-e71e-4464-83f6-6436a8a72daa tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:10.118829 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-7fe382ca-46d0-465b-80e3-1925fcb6bd2f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:10.125672 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-9b8e73f1-e71e-4464-83f6-6436a8a72daa tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:10.127064 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-7fe382ca-46d0-465b-80e3-1925fcb6bd2f tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 200 len: 1367 microversion: 2.1 time: 0.213724 May 23 16:54:10.127654 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 388/747] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:54:09 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:54:10.133684 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-9b8e73f1-e71e-4464-83f6-6436a8a72daa tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:10.135193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-9b8e73f1-e71e-4464-83f6-6436a8a72daa tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:10.136384 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-9b8e73f1-e71e-4464-83f6-6436a8a72daa tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1721 microversion: 2.20 time: 0.205205 May 23 16:54:10.136930 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 360/748] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:09 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:54:11.143835 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-baa919dc-cd30-46c9-aa3e-e432633dffb3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:11.144483 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-baa919dc-cd30-46c9-aa3e-e432633dffb3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:11.150880 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-baa919dc-cd30-46c9-aa3e-e432633dffb3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:11.151323 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-baa919dc-cd30-46c9-aa3e-e432633dffb3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:11.152078 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-baa919dc-cd30-46c9-aa3e-e432633dffb3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:11.152549 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-baa919dc-cd30-46c9-aa3e-e432633dffb3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:11.155364 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-abc0b080-f60d-49cd-a7e0-b145eabd6abd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:11.156023 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-abc0b080-f60d-49cd-a7e0-b145eabd6abd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:11.162574 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-abc0b080-f60d-49cd-a7e0-b145eabd6abd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:11.163026 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-abc0b080-f60d-49cd-a7e0-b145eabd6abd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:11.163800 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-abc0b080-f60d-49cd-a7e0-b145eabd6abd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:11.164240 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-abc0b080-f60d-49cd-a7e0-b145eabd6abd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:11.349486 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-baa919dc-cd30-46c9-aa3e-e432633dffb3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:11.353262 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-abc0b080-f60d-49cd-a7e0-b145eabd6abd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:11.358430 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-baa919dc-cd30-46c9-aa3e-e432633dffb3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 200 len: 1367 microversion: 2.1 time: 0.218371 May 23 16:54:11.359124 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 389/749] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:54:11 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:54:11.362046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-abc0b080-f60d-49cd-a7e0-b145eabd6abd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:11.363556 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-abc0b080-f60d-49cd-a7e0-b145eabd6abd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:11.364757 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-abc0b080-f60d-49cd-a7e0-b145eabd6abd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1721 microversion: 2.20 time: 0.213776 May 23 16:54:11.365307 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 361/750] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:11 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:54:12.375025 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-78c5c4a5-867a-494d-bd90-1ea27a43bba2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:12.375555 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-78c5c4a5-867a-494d-bd90-1ea27a43bba2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:12.382096 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-78c5c4a5-867a-494d-bd90-1ea27a43bba2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:12.382577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-78c5c4a5-867a-494d-bd90-1ea27a43bba2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:12.383338 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-78c5c4a5-867a-494d-bd90-1ea27a43bba2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:12.383785 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-78c5c4a5-867a-494d-bd90-1ea27a43bba2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:12.384704 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-cdb3030d-9157-409d-b946-f6c0eb5e3bde tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:12.385394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-cdb3030d-9157-409d-b946-f6c0eb5e3bde tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:12.392861 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cdb3030d-9157-409d-b946-f6c0eb5e3bde tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:12.393409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cdb3030d-9157-409d-b946-f6c0eb5e3bde tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:12.394237 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cdb3030d-9157-409d-b946-f6c0eb5e3bde tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:12.394676 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cdb3030d-9157-409d-b946-f6c0eb5e3bde tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:12.596541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-78c5c4a5-867a-494d-bd90-1ea27a43bba2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:12.598235 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-cdb3030d-9157-409d-b946-f6c0eb5e3bde tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:12.604662 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-78c5c4a5-867a-494d-bd90-1ea27a43bba2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 200 len: 1367 microversion: 2.1 time: 0.233708 May 23 16:54:12.605588 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 390/751] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:54:12 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:54:12.608004 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-cdb3030d-9157-409d-b946-f6c0eb5e3bde tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:12.609652 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-cdb3030d-9157-409d-b946-f6c0eb5e3bde tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:12.610869 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-cdb3030d-9157-409d-b946-f6c0eb5e3bde tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1721 microversion: 2.20 time: 0.232038 May 23 16:54:12.611556 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 362/752] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:12 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:13.622222 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-b1ec46ec-ab6c-49e1-9246-9c460077ce48 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:13.622833 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-b1ec46ec-ab6c-49e1-9246-9c460077ce48 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:13.625145 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:13.629311 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ebc1a9dc-e633-4b01-a347-80ab905967ed tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:13.629927 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ebc1a9dc-e633-4b01-a347-80ab905967ed tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:13.630527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b1ec46ec-ab6c-49e1-9246-9c460077ce48 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:13.630975 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b1ec46ec-ab6c-49e1-9246-9c460077ce48 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:13.631744 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b1ec46ec-ab6c-49e1-9246-9c460077ce48 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:13.632181 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b1ec46ec-ab6c-49e1-9246-9c460077ce48 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:13.636592 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ebc1a9dc-e633-4b01-a347-80ab905967ed tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:13.637105 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ebc1a9dc-e633-4b01-a347-80ab905967ed tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:13.637947 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ebc1a9dc-e633-4b01-a347-80ab905967ed tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:13.638441 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ebc1a9dc-e633-4b01-a347-80ab905967ed tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:13.826982 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-b1ec46ec-ab6c-49e1-9246-9c460077ce48 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:13.829829 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ebc1a9dc-e633-4b01-a347-80ab905967ed tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:13.836494 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-b1ec46ec-ab6c-49e1-9246-9c460077ce48 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 200 len: 1558 microversion: 2.1 time: 0.218072 May 23 16:54:13.837080 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 391/753] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:54:13 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:54:13.839015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ebc1a9dc-e633-4b01-a347-80ab905967ed tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:13.841026 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ebc1a9dc-e633-4b01-a347-80ab905967ed tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:13.842214 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ebc1a9dc-e633-4b01-a347-80ab905967ed tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1721 microversion: 2.20 time: 0.217308 May 23 16:54:13.843078 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 363/754] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:13 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:54:13.853606 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-2c7872ee-ece5-4d33-b255-f26c7457a326 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:13.854110 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-2c7872ee-ece5-4d33-b255-f26c7457a326 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:13.860707 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2c7872ee-ece5-4d33-b255-f26c7457a326 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:13.861162 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2c7872ee-ece5-4d33-b255-f26c7457a326 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:13.861927 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2c7872ee-ece5-4d33-b255-f26c7457a326 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:13.862366 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2c7872ee-ece5-4d33-b255-f26c7457a326 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:13.941346 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-2c7872ee-ece5-4d33-b255-f26c7457a326 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092327 May 23 16:54:13.941934 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 392/755] 10.222.0.74 () {58 vars in 1274 bytes} [Mon May 23 16:54:13 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:54:14.861270 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ff6da5d5-bf70-49d9-ab01-e88ce90c703f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:14.861884 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ff6da5d5-bf70-49d9-ab01-e88ce90c703f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:14.868218 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ff6da5d5-bf70-49d9-ab01-e88ce90c703f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:14.868703 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ff6da5d5-bf70-49d9-ab01-e88ce90c703f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:14.869478 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ff6da5d5-bf70-49d9-ab01-e88ce90c703f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:14.869925 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ff6da5d5-bf70-49d9-ab01-e88ce90c703f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:14.980017 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-ca47bded-b180-426d-88e3-30c65855cf09 req-b818357b-130a-4ffd-bcfe-401339962209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4b22328-963e-4a51-8ace-087e5b74cb2f", "tag": "a163250d-cd50-475a-b6a2-fbdd4207e65f"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:54:14.989530 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-ca47bded-b180-426d-88e3-30c65855cf09 req-b818357b-130a-4ffd-bcfe-401339962209 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:14.990094 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-ca47bded-b180-426d-88e3-30c65855cf09 req-b818357b-130a-4ffd-bcfe-401339962209 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:15.002141 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-ca47bded-b180-426d-88e3-30c65855cf09 req-b818357b-130a-4ffd-bcfe-401339962209 service nova] Creating event network-changed:a163250d-cd50-475a-b6a2-fbdd4207e65f for instance f4b22328-963e-4a51-8ace-087e5b74cb2f on hv-cinder-83925 May 23 16:54:15.007296 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-ca47bded-b180-426d-88e3-30c65855cf09 req-b818357b-130a-4ffd-bcfe-401339962209 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031625 May 23 16:54:15.007998 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 393/756] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:54:15.037850 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ff6da5d5-bf70-49d9-ab01-e88ce90c703f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:15.047233 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ff6da5d5-bf70-49d9-ab01-e88ce90c703f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:15.048980 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ff6da5d5-bf70-49d9-ab01-e88ce90c703f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:15.050229 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ff6da5d5-bf70-49d9-ab01-e88ce90c703f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1721 microversion: 2.20 time: 0.193340 May 23 16:54:15.050928 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 364/757] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:14 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:16.069398 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-f3d44cf6-4df5-4377-a639-0fe97020d5ea tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:16.070211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-f3d44cf6-4df5-4377-a639-0fe97020d5ea tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:16.076934 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f3d44cf6-4df5-4377-a639-0fe97020d5ea tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:16.077391 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f3d44cf6-4df5-4377-a639-0fe97020d5ea tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:16.078170 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f3d44cf6-4df5-4377-a639-0fe97020d5ea tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:16.078612 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f3d44cf6-4df5-4377-a639-0fe97020d5ea tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:16.213685 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f3d44cf6-4df5-4377-a639-0fe97020d5ea tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:16.221845 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f3d44cf6-4df5-4377-a639-0fe97020d5ea tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:16.223390 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f3d44cf6-4df5-4377-a639-0fe97020d5ea tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:16.224576 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-f3d44cf6-4df5-4377-a639-0fe97020d5ea tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1721 microversion: 2.20 time: 0.160241 May 23 16:54:16.225137 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 394/758] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:16 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:17.244049 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-de230df3-8f7f-47b8-8db5-d6fbf5e97e4d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:17.244684 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-de230df3-8f7f-47b8-8db5-d6fbf5e97e4d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:17.253684 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-de230df3-8f7f-47b8-8db5-d6fbf5e97e4d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:17.254142 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-de230df3-8f7f-47b8-8db5-d6fbf5e97e4d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:17.254953 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-de230df3-8f7f-47b8-8db5-d6fbf5e97e4d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:17.255401 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-de230df3-8f7f-47b8-8db5-d6fbf5e97e4d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:17.384471 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-de230df3-8f7f-47b8-8db5-d6fbf5e97e4d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:17.392569 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-de230df3-8f7f-47b8-8db5-d6fbf5e97e4d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:17.394086 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-de230df3-8f7f-47b8-8db5-d6fbf5e97e4d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:17.395445 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-de230df3-8f7f-47b8-8db5-d6fbf5e97e4d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1742 microversion: 2.20 time: 0.155354 May 23 16:54:17.396016 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 365/759] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:17 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:18.414265 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-75f280c6-1198-4c23-b79a-3fd424ed2233 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:18.415002 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-75f280c6-1198-4c23-b79a-3fd424ed2233 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:18.422261 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-75f280c6-1198-4c23-b79a-3fd424ed2233 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:18.422713 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-75f280c6-1198-4c23-b79a-3fd424ed2233 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:18.423480 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-75f280c6-1198-4c23-b79a-3fd424ed2233 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:18.423916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-75f280c6-1198-4c23-b79a-3fd424ed2233 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:18.778411 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-75f280c6-1198-4c23-b79a-3fd424ed2233 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:18.786344 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-75f280c6-1198-4c23-b79a-3fd424ed2233 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:18.787853 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-75f280c6-1198-4c23-b79a-3fd424ed2233 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:18.789049 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-75f280c6-1198-4c23-b79a-3fd424ed2233 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1742 microversion: 2.20 time: 0.378729 May 23 16:54:18.789611 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 395/760] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:18 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1742 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:19.807084 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-0c2b840c-2374-40ce-9616-d6ca3942d501 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:19.807710 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-0c2b840c-2374-40ce-9616-d6ca3942d501 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:19.815309 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0c2b840c-2374-40ce-9616-d6ca3942d501 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:19.815954 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0c2b840c-2374-40ce-9616-d6ca3942d501 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:19.816771 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0c2b840c-2374-40ce-9616-d6ca3942d501 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:19.817217 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0c2b840c-2374-40ce-9616-d6ca3942d501 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:19.955327 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-0c2b840c-2374-40ce-9616-d6ca3942d501 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:19.963863 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-0c2b840c-2374-40ce-9616-d6ca3942d501 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:19.965525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-0c2b840c-2374-40ce-9616-d6ca3942d501 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:19.966703 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-0c2b840c-2374-40ce-9616-d6ca3942d501 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1742 microversion: 2.20 time: 0.163756 May 23 16:54:19.967258 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 366/761] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:19 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:20.984189 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-2b85f6ce-f7fd-492f-baf5-18064d9ee03b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:20.984833 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-2b85f6ce-f7fd-492f-baf5-18064d9ee03b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:20.991325 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2b85f6ce-f7fd-492f-baf5-18064d9ee03b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:20.991773 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2b85f6ce-f7fd-492f-baf5-18064d9ee03b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:20.992573 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2b85f6ce-f7fd-492f-baf5-18064d9ee03b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:20.993010 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2b85f6ce-f7fd-492f-baf5-18064d9ee03b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:21.130130 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-2b85f6ce-f7fd-492f-baf5-18064d9ee03b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:21.138161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-2b85f6ce-f7fd-492f-baf5-18064d9ee03b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:21.139668 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-2b85f6ce-f7fd-492f-baf5-18064d9ee03b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:21.140852 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-2b85f6ce-f7fd-492f-baf5-18064d9ee03b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1742 microversion: 2.20 time: 0.160570 May 23 16:54:21.141400 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 396/762] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:20 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:21.585701 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-6675d5dd-917e-4f6d-9067-189f63c19451 req-b8b5e6d7-3b38-48a5-a647-82c0bf40e05b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa18b171-8b37-4fcc-b7e9-e50494e967af", "name": "network-vif-plugged", "status": "completed", "tag": "7fc3fb4c-c736-453c-a8e0-bd34a6233442"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:54:21.594994 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-6675d5dd-917e-4f6d-9067-189f63c19451 req-b8b5e6d7-3b38-48a5-a647-82c0bf40e05b service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:21.595482 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-6675d5dd-917e-4f6d-9067-189f63c19451 req-b8b5e6d7-3b38-48a5-a647-82c0bf40e05b service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:21.608857 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-6675d5dd-917e-4f6d-9067-189f63c19451 req-b8b5e6d7-3b38-48a5-a647-82c0bf40e05b service nova] Creating event network-vif-plugged:7fc3fb4c-c736-453c-a8e0-bd34a6233442 for instance fa18b171-8b37-4fcc-b7e9-e50494e967af on hv-cinder-83925 May 23 16:54:21.614272 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-6675d5dd-917e-4f6d-9067-189f63c19451 req-b8b5e6d7-3b38-48a5-a647-82c0bf40e05b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032625 May 23 16:54:21.615150 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 367/763] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:54:22.160599 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-ca5226b2-b9dc-4f02-a143-8af4782c8e1b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:22.161349 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-ca5226b2-b9dc-4f02-a143-8af4782c8e1b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:22.169677 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ca5226b2-b9dc-4f02-a143-8af4782c8e1b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:22.170502 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ca5226b2-b9dc-4f02-a143-8af4782c8e1b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:22.171448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ca5226b2-b9dc-4f02-a143-8af4782c8e1b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:22.172098 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ca5226b2-b9dc-4f02-a143-8af4782c8e1b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:22.344436 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-ca5226b2-b9dc-4f02-a143-8af4782c8e1b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:22.356979 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-ca5226b2-b9dc-4f02-a143-8af4782c8e1b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:22.358541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-ca5226b2-b9dc-4f02-a143-8af4782c8e1b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:22.361500 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-ca5226b2-b9dc-4f02-a143-8af4782c8e1b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1742 microversion: 2.20 time: 0.203866 May 23 16:54:22.362457 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 397/764] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:22 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1742 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:23.383069 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-15842f56-0e1e-45e6-a3f5-0ef580099293 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:23.384440 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-15842f56-0e1e-45e6-a3f5-0ef580099293 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:23.392439 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-15842f56-0e1e-45e6-a3f5-0ef580099293 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:23.393427 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-15842f56-0e1e-45e6-a3f5-0ef580099293 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:23.394379 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-15842f56-0e1e-45e6-a3f5-0ef580099293 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:23.394984 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-15842f56-0e1e-45e6-a3f5-0ef580099293 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:23.623634 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-15842f56-0e1e-45e6-a3f5-0ef580099293 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:23.636060 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-15842f56-0e1e-45e6-a3f5-0ef580099293 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:23.638436 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-15842f56-0e1e-45e6-a3f5-0ef580099293 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:23.639664 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-15842f56-0e1e-45e6-a3f5-0ef580099293 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1737 microversion: 2.20 time: 0.261301 May 23 16:54:23.640234 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 368/765] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:23 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1737 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:24.659724 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a8cf7067-8560-465d-9424-3355112ae069 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:24.660972 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a8cf7067-8560-465d-9424-3355112ae069 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:24.672141 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a8cf7067-8560-465d-9424-3355112ae069 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:24.676009 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a8cf7067-8560-465d-9424-3355112ae069 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:24.677740 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a8cf7067-8560-465d-9424-3355112ae069 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:24.680963 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a8cf7067-8560-465d-9424-3355112ae069 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:24.895764 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a8cf7067-8560-465d-9424-3355112ae069 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:24.906935 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a8cf7067-8560-465d-9424-3355112ae069 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:24.909298 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a8cf7067-8560-465d-9424-3355112ae069 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:24.910829 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a8cf7067-8560-465d-9424-3355112ae069 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1737 microversion: 2.20 time: 0.255270 May 23 16:54:24.924177 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 398/766] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:24 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1737 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:25.930626 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-b3bd07b4-bf83-46f8-a71f-ff0e9b3f3c05 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:25.931353 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-b3bd07b4-bf83-46f8-a71f-ff0e9b3f3c05 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:25.939811 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b3bd07b4-bf83-46f8-a71f-ff0e9b3f3c05 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:25.940625 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b3bd07b4-bf83-46f8-a71f-ff0e9b3f3c05 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:25.941652 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b3bd07b4-bf83-46f8-a71f-ff0e9b3f3c05 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:25.942318 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b3bd07b4-bf83-46f8-a71f-ff0e9b3f3c05 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:26.124134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b3bd07b4-bf83-46f8-a71f-ff0e9b3f3c05 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:26.134664 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b3bd07b4-bf83-46f8-a71f-ff0e9b3f3c05 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:26.136660 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b3bd07b4-bf83-46f8-a71f-ff0e9b3f3c05 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:26.139166 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-b3bd07b4-bf83-46f8-a71f-ff0e9b3f3c05 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1737 microversion: 2.20 time: 0.213663 May 23 16:54:26.150850 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 369/767] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:25 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1737 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:27.159535 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-68ba3a1c-6451-4fb0-8d88-9c3b45bfa273 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:27.161149 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-68ba3a1c-6451-4fb0-8d88-9c3b45bfa273 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:27.168189 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-68ba3a1c-6451-4fb0-8d88-9c3b45bfa273 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:27.168706 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-68ba3a1c-6451-4fb0-8d88-9c3b45bfa273 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:27.169485 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-68ba3a1c-6451-4fb0-8d88-9c3b45bfa273 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:27.169922 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-68ba3a1c-6451-4fb0-8d88-9c3b45bfa273 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:27.309841 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-68ba3a1c-6451-4fb0-8d88-9c3b45bfa273 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:27.320664 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-68ba3a1c-6451-4fb0-8d88-9c3b45bfa273 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:27.322872 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-68ba3a1c-6451-4fb0-8d88-9c3b45bfa273 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:27.324118 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-68ba3a1c-6451-4fb0-8d88-9c3b45bfa273 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1737 microversion: 2.20 time: 0.168754 May 23 16:54:27.325173 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 399/768] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:27 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:28.352181 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-9b3f4680-aab4-4d94-8b28-9972a1f240b2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:28.352181 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-9b3f4680-aab4-4d94-8b28-9972a1f240b2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:28.358325 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9b3f4680-aab4-4d94-8b28-9972a1f240b2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:28.358818 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9b3f4680-aab4-4d94-8b28-9972a1f240b2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:28.359631 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9b3f4680-aab4-4d94-8b28-9972a1f240b2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:28.360162 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9b3f4680-aab4-4d94-8b28-9972a1f240b2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:28.584476 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-9b3f4680-aab4-4d94-8b28-9972a1f240b2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:28.587556 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=100 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:28.596262 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-9b3f4680-aab4-4d94-8b28-9972a1f240b2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:28.598096 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-9b3f4680-aab4-4d94-8b28-9972a1f240b2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:28.599590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-9b3f4680-aab4-4d94-8b28-9972a1f240b2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1737 microversion: 2.20 time: 0.257595 May 23 16:54:28.600660 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 370/769] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:28 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1737 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:29.624099 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-5455a616-4593-42b7-943d-17dc56e007fd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:29.626998 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-5455a616-4593-42b7-943d-17dc56e007fd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:29.632200 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5455a616-4593-42b7-943d-17dc56e007fd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:29.632916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5455a616-4593-42b7-943d-17dc56e007fd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:29.634467 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5455a616-4593-42b7-943d-17dc56e007fd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:29.635238 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5455a616-4593-42b7-943d-17dc56e007fd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:29.827646 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-5455a616-4593-42b7-943d-17dc56e007fd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:29.837964 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-5455a616-4593-42b7-943d-17dc56e007fd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:29.843199 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-5455a616-4593-42b7-943d-17dc56e007fd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:29.869653 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-5455a616-4593-42b7-943d-17dc56e007fd tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1737 microversion: 2.20 time: 0.242069 May 23 16:54:29.869653 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 400/770] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:29 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1737 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:54:30.887639 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-6f574ade-f81d-4833-abf7-536926d99d42 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:30.888644 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-6f574ade-f81d-4833-abf7-536926d99d42 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:30.899289 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6f574ade-f81d-4833-abf7-536926d99d42 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:30.899995 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6f574ade-f81d-4833-abf7-536926d99d42 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:30.901004 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6f574ade-f81d-4833-abf7-536926d99d42 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:30.901660 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6f574ade-f81d-4833-abf7-536926d99d42 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:31.096619 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-6f574ade-f81d-4833-abf7-536926d99d42 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:31.109343 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-6f574ade-f81d-4833-abf7-536926d99d42 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:31.119292 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-6f574ade-f81d-4833-abf7-536926d99d42 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:31.119292 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-6f574ade-f81d-4833-abf7-536926d99d42 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1737 microversion: 2.20 time: 0.230105 May 23 16:54:31.119292 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 371/771] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:30 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1737 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:32.131253 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-1f058300-f0e2-4d56-aa3c-5ea4f736c175 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:32.132022 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-1f058300-f0e2-4d56-aa3c-5ea4f736c175 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:32.139492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1f058300-f0e2-4d56-aa3c-5ea4f736c175 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:32.140237 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1f058300-f0e2-4d56-aa3c-5ea4f736c175 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:32.141286 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1f058300-f0e2-4d56-aa3c-5ea4f736c175 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:32.142122 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1f058300-f0e2-4d56-aa3c-5ea4f736c175 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:32.167927 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=100 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:32.307686 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-1f058300-f0e2-4d56-aa3c-5ea4f736c175 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:32.323433 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-1f058300-f0e2-4d56-aa3c-5ea4f736c175 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:32.325147 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-1f058300-f0e2-4d56-aa3c-5ea4f736c175 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:32.342720 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-1f058300-f0e2-4d56-aa3c-5ea4f736c175 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1737 microversion: 2.20 time: 0.215268 May 23 16:54:32.349316 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 401/772] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:32 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:33.363895 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-cc173281-579c-46ef-93c4-4012286e96a1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:33.364640 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-cc173281-579c-46ef-93c4-4012286e96a1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:33.367646 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=40 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:33.379332 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cc173281-579c-46ef-93c4-4012286e96a1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:33.379794 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cc173281-579c-46ef-93c4-4012286e96a1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:33.380776 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cc173281-579c-46ef-93c4-4012286e96a1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:33.381251 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cc173281-579c-46ef-93c4-4012286e96a1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:33.566549 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-cc173281-579c-46ef-93c4-4012286e96a1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:33.604110 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-cc173281-579c-46ef-93c4-4012286e96a1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:33.611529 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-cc173281-579c-46ef-93c4-4012286e96a1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:33.615644 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-cc173281-579c-46ef-93c4-4012286e96a1 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1737 microversion: 2.20 time: 0.253176 May 23 16:54:33.617841 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 372/773] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:33 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1737 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:34.633210 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-d349eb96-f9ab-4715-b8f7-959a49fd2e18 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:34.634032 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-d349eb96-f9ab-4715-b8f7-959a49fd2e18 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:34.645679 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d349eb96-f9ab-4715-b8f7-959a49fd2e18 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:34.646226 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d349eb96-f9ab-4715-b8f7-959a49fd2e18 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:34.647021 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d349eb96-f9ab-4715-b8f7-959a49fd2e18 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:34.647470 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d349eb96-f9ab-4715-b8f7-959a49fd2e18 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:34.802498 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-30b16dfd-7f82-4c1d-8252-ad3a2e64206b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Action: 'create', calling method: .version_select at 0x7f224c3af670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-877096425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiKN+S4+u+1DF8PX4rcoiiAATFxPYXVQwSKn4LPTG9/FyvcCUDAzKYUPEiXqtUgDcDsb17UdZuAHHFsu/YSwxDqM2IheTqQkXKOqlzcXS38fBfZ6Ce6yCA55oEEdRvqlw=="}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:54:34.829684 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-30b16dfd-7f82-4c1d-8252-ad3a2e64206b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Getting quotas for project 8d09d9819e564152aacc661d1da68fcd. Resources: {'key_pairs'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:54:34.836652 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-30b16dfd-7f82-4c1d-8252-ad3a2e64206b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Getting quotas for user 2aa01ac54736475188dbc47f3cda4de1 and project 8d09d9819e564152aacc661d1da68fcd. Resources: {'key_pairs'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:54:34.875116 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-d349eb96-f9ab-4715-b8f7-959a49fd2e18 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:34.884581 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-d349eb96-f9ab-4715-b8f7-959a49fd2e18 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:34.886184 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-d349eb96-f9ab-4715-b8f7-959a49fd2e18 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:34.887654 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-d349eb96-f9ab-4715-b8f7-959a49fd2e18 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1737 microversion: 2.20 time: 0.258321 May 23 16:54:34.898270 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 373/774] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:34 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1737 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:34.940531 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-30b16dfd-7f82-4c1d-8252-ad3a2e64206b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.448270 May 23 16:54:34.941327 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 402/775] 10.222.0.74 () {60 vars in 1158 bytes} [Mon May 23 16:54:34 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:54:35.906083 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-8af14a63-64b6-48b4-be19-0b222f45c16e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:35.906696 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-8af14a63-64b6-48b4-be19-0b222f45c16e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:35.916665 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8af14a63-64b6-48b4-be19-0b222f45c16e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:35.917125 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8af14a63-64b6-48b4-be19-0b222f45c16e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:35.925827 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8af14a63-64b6-48b4-be19-0b222f45c16e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:35.926604 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8af14a63-64b6-48b4-be19-0b222f45c16e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:36.127334 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8af14a63-64b6-48b4-be19-0b222f45c16e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:36.135901 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8af14a63-64b6-48b4-be19-0b222f45c16e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:36.139459 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8af14a63-64b6-48b4-be19-0b222f45c16e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:36.146115 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-8af14a63-64b6-48b4-be19-0b222f45c16e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1737 microversion: 2.20 time: 0.238645 May 23 16:54:36.146115 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 374/776] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:35 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1737 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:37.162235 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e452e9aa-0189-42b7-b1e8-d11a9d4cc2e9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:37.162907 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e452e9aa-0189-42b7-b1e8-d11a9d4cc2e9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:37.175699 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e452e9aa-0189-42b7-b1e8-d11a9d4cc2e9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:37.176163 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e452e9aa-0189-42b7-b1e8-d11a9d4cc2e9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:37.177001 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e452e9aa-0189-42b7-b1e8-d11a9d4cc2e9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:37.177448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e452e9aa-0189-42b7-b1e8-d11a9d4cc2e9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:37.415509 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e452e9aa-0189-42b7-b1e8-d11a9d4cc2e9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:37.439245 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e452e9aa-0189-42b7-b1e8-d11a9d4cc2e9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:37.441038 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e452e9aa-0189-42b7-b1e8-d11a9d4cc2e9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:37.442263 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e452e9aa-0189-42b7-b1e8-d11a9d4cc2e9 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1737 microversion: 2.20 time: 0.284754 May 23 16:54:37.443857 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 403/777] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:37 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1737 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:38.461328 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-4e9f62df-f6b6-4c3c-b278-d8f151b177eb tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:38.461951 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-4e9f62df-f6b6-4c3c-b278-d8f151b177eb tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:38.474024 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4e9f62df-f6b6-4c3c-b278-d8f151b177eb tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:38.474490 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4e9f62df-f6b6-4c3c-b278-d8f151b177eb tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:38.475318 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4e9f62df-f6b6-4c3c-b278-d8f151b177eb tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:38.475767 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4e9f62df-f6b6-4c3c-b278-d8f151b177eb tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:38.649331 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-4e9f62df-f6b6-4c3c-b278-d8f151b177eb tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:38.659508 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-4e9f62df-f6b6-4c3c-b278-d8f151b177eb tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:38.661123 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-4e9f62df-f6b6-4c3c-b278-d8f151b177eb tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:38.662379 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-4e9f62df-f6b6-4c3c-b278-d8f151b177eb tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1737 microversion: 2.20 time: 0.205266 May 23 16:54:38.669485 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 375/778] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:38 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:54:39.681238 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-f9786d3e-5ba8-453f-a303-fa7336328995 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:39.681867 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-f9786d3e-5ba8-453f-a303-fa7336328995 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:39.690813 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f9786d3e-5ba8-453f-a303-fa7336328995 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:39.691283 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f9786d3e-5ba8-453f-a303-fa7336328995 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:39.692063 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f9786d3e-5ba8-453f-a303-fa7336328995 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:39.692620 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f9786d3e-5ba8-453f-a303-fa7336328995 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:39.835939 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f9786d3e-5ba8-453f-a303-fa7336328995 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:39.844531 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f9786d3e-5ba8-453f-a303-fa7336328995 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:39.846018 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f9786d3e-5ba8-453f-a303-fa7336328995 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:39.847205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-f9786d3e-5ba8-453f-a303-fa7336328995 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1719 microversion: 2.20 time: 0.169740 May 23 16:54:39.847700 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 404/779] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:39 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1719 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:40.867445 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-dba5ff4d-d070-4f8e-a35f-3d41a14549a2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:40.868074 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-dba5ff4d-d070-4f8e-a35f-3d41a14549a2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:40.875730 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dba5ff4d-d070-4f8e-a35f-3d41a14549a2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:40.876187 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dba5ff4d-d070-4f8e-a35f-3d41a14549a2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:40.877005 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dba5ff4d-d070-4f8e-a35f-3d41a14549a2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:40.877460 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dba5ff4d-d070-4f8e-a35f-3d41a14549a2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:41.007118 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-dba5ff4d-d070-4f8e-a35f-3d41a14549a2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:41.015770 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-dba5ff4d-d070-4f8e-a35f-3d41a14549a2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:41.017313 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-dba5ff4d-d070-4f8e-a35f-3d41a14549a2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:41.018842 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-dba5ff4d-d070-4f8e-a35f-3d41a14549a2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1719 microversion: 2.20 time: 0.155840 May 23 16:54:41.020067 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 376/780] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:40 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:42.036573 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-da1e8e3e-b9ff-4780-a120-bcfa8a1a779d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:42.037195 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-da1e8e3e-b9ff-4780-a120-bcfa8a1a779d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:42.044812 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-da1e8e3e-b9ff-4780-a120-bcfa8a1a779d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:42.045274 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-da1e8e3e-b9ff-4780-a120-bcfa8a1a779d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:42.046074 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-da1e8e3e-b9ff-4780-a120-bcfa8a1a779d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:42.046555 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-da1e8e3e-b9ff-4780-a120-bcfa8a1a779d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:42.182431 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-da1e8e3e-b9ff-4780-a120-bcfa8a1a779d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:42.193516 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-da1e8e3e-b9ff-4780-a120-bcfa8a1a779d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:42.194927 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-da1e8e3e-b9ff-4780-a120-bcfa8a1a779d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:42.196105 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-da1e8e3e-b9ff-4780-a120-bcfa8a1a779d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1722 microversion: 2.20 time: 0.163529 May 23 16:54:42.196691 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 405/781] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:42 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:42.218203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-87292c32-fcfd-43a9-b945-6f9f19b65b25 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cac99482-ef9d-484a-b663-747a541fb23c"}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:54:42.219273 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-87292c32-fcfd-43a9-b945-6f9f19b65b25 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:42.225943 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-87292c32-fcfd-43a9-b945-6f9f19b65b25 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:42.226402 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-87292c32-fcfd-43a9-b945-6f9f19b65b25 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:42.227180 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-87292c32-fcfd-43a9-b945-6f9f19b65b25 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:42.227629 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-87292c32-fcfd-43a9-b945-6f9f19b65b25 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:43.220594 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-87292c32-fcfd-43a9-b945-6f9f19b65b25 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "POST /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.007618 May 23 16:54:43.221225 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 377/782] 10.222.0.74 () {62 vars in 1363 bytes} [Mon May 23 16:54:42 2022] POST /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af/os-volume_attachments => generated 188 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 16:54:43.340321 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-27980547-d513-48b8-8979-2c1d147e2eeb tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:43.340864 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-27980547-d513-48b8-8979-2c1d147e2eeb tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:43.347420 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-27980547-d513-48b8-8979-2c1d147e2eeb tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:43.347873 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-27980547-d513-48b8-8979-2c1d147e2eeb tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:43.348660 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-27980547-d513-48b8-8979-2c1d147e2eeb tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:43.349102 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-27980547-d513-48b8-8979-2c1d147e2eeb tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:43.465899 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-ccf62026-787b-4aad-8c74-95baae400891 req-2727df5e-e347-457b-8ef8-83c1aa2d3c65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa18b171-8b37-4fcc-b7e9-e50494e967af", "name": "network-vif-unplugged", "status": "completed", "tag": "7fc3fb4c-c736-453c-a8e0-bd34a6233442"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:54:43.476660 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-ccf62026-787b-4aad-8c74-95baae400891 req-2727df5e-e347-457b-8ef8-83c1aa2d3c65 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:43.477105 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-ccf62026-787b-4aad-8c74-95baae400891 req-2727df5e-e347-457b-8ef8-83c1aa2d3c65 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:43.487582 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.compute.server_external_events [req-ccf62026-787b-4aad-8c74-95baae400891 req-2727df5e-e347-457b-8ef8-83c1aa2d3c65 service nova] Unable to find a host for instance fa18b171-8b37-4fcc-b7e9-e50494e967af. Dropping event network-vif-unplugged {{(pid=124714) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 23 16:54:43.488530 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-ccf62026-787b-4aad-8c74-95baae400891 req-2727df5e-e347-457b-8ef8-83c1aa2d3c65 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026542 May 23 16:54:43.489114 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 378/783] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 23 16:54:43.940537 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-27980547-d513-48b8-8979-2c1d147e2eeb tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "DELETE /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af/os-volume_attachments/cac99482-ef9d-484a-b663-747a541fb23c" status: 202 len: 0 microversion: 2.20 time: 0.604209 May 23 16:54:43.941140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 406/784] 10.222.0.74 () {60 vars in 1456 bytes} [Mon May 23 16:54:43 2022] DELETE /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af/os-volume_attachments/cac99482-ef9d-484a-b663-747a541fb23c => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 16:54:43.999101 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-d02f2ab8-f140-4f90-8190-0be5f9a6906b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:54:43.999665 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-d02f2ab8-f140-4f90-8190-0be5f9a6906b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:44.005632 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d02f2ab8-f140-4f90-8190-0be5f9a6906b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:44.006082 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d02f2ab8-f140-4f90-8190-0be5f9a6906b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:44.006837 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d02f2ab8-f140-4f90-8190-0be5f9a6906b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:44.007282 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d02f2ab8-f140-4f90-8190-0be5f9a6906b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:44.275613 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-d02f2ab8-f140-4f90-8190-0be5f9a6906b tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "POST /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af/action" status: 202 len: 0 microversion: 2.20 time: 0.280782 May 23 16:54:44.278119 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 379/785] 10.222.0.74 () {62 vars in 1318 bytes} [Mon May 23 16:54:43 2022] POST /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 16:54:44.286887 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c5582bc3-b829-4cd2-ba92-e99f3cb25a29 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:44.288006 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-c5582bc3-b829-4cd2-ba92-e99f3cb25a29 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:44.291323 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:44.295496 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c5582bc3-b829-4cd2-ba92-e99f3cb25a29 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:44.295947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c5582bc3-b829-4cd2-ba92-e99f3cb25a29 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:44.296868 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c5582bc3-b829-4cd2-ba92-e99f3cb25a29 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:44.297313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c5582bc3-b829-4cd2-ba92-e99f3cb25a29 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:44.435584 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-c5582bc3-b829-4cd2-ba92-e99f3cb25a29 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:44.444666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-c5582bc3-b829-4cd2-ba92-e99f3cb25a29 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:44.446188 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-c5582bc3-b829-4cd2-ba92-e99f3cb25a29 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:44.447355 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-c5582bc3-b829-4cd2-ba92-e99f3cb25a29 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1670 microversion: 2.20 time: 0.164926 May 23 16:54:44.447974 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 407/786] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:44 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1670 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:45.468607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-84b84d7f-fb5a-4d29-a0a3-ad4a06b4c289 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:45.469387 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-84b84d7f-fb5a-4d29-a0a3-ad4a06b4c289 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:45.475866 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-84b84d7f-fb5a-4d29-a0a3-ad4a06b4c289 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:45.476445 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-84b84d7f-fb5a-4d29-a0a3-ad4a06b4c289 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:45.477240 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-84b84d7f-fb5a-4d29-a0a3-ad4a06b4c289 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:45.477678 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-84b84d7f-fb5a-4d29-a0a3-ad4a06b4c289 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:45.615138 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-84b84d7f-fb5a-4d29-a0a3-ad4a06b4c289 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:45.623921 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-84b84d7f-fb5a-4d29-a0a3-ad4a06b4c289 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:45.625425 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-84b84d7f-fb5a-4d29-a0a3-ad4a06b4c289 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:45.626586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-84b84d7f-fb5a-4d29-a0a3-ad4a06b4c289 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1670 microversion: 2.20 time: 0.163642 May 23 16:54:45.627574 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 380/787] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:45 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:46.646794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-51084728-8b57-4fe6-97c1-6871745a905c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:46.647418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-51084728-8b57-4fe6-97c1-6871745a905c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:46.649391 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=4 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:46.656090 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-51084728-8b57-4fe6-97c1-6871745a905c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:46.656582 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-51084728-8b57-4fe6-97c1-6871745a905c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:46.657361 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-51084728-8b57-4fe6-97c1-6871745a905c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:46.657926 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-51084728-8b57-4fe6-97c1-6871745a905c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:46.815940 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-51084728-8b57-4fe6-97c1-6871745a905c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:46.824720 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-51084728-8b57-4fe6-97c1-6871745a905c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:46.826298 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-51084728-8b57-4fe6-97c1-6871745a905c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:46.827465 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-51084728-8b57-4fe6-97c1-6871745a905c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1728 microversion: 2.20 time: 0.184623 May 23 16:54:46.828034 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 408/788] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:46 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:47.858616 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-fdf4e9ca-5fb2-45c3-8b07-ba0b78d7fdef tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:47.861107 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-fdf4e9ca-5fb2-45c3-8b07-ba0b78d7fdef tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:47.875738 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fdf4e9ca-5fb2-45c3-8b07-ba0b78d7fdef tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:47.877213 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fdf4e9ca-5fb2-45c3-8b07-ba0b78d7fdef tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:47.886854 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fdf4e9ca-5fb2-45c3-8b07-ba0b78d7fdef tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:47.888022 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fdf4e9ca-5fb2-45c3-8b07-ba0b78d7fdef tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:48.047037 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-fdf4e9ca-5fb2-45c3-8b07-ba0b78d7fdef tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:48.055319 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-fdf4e9ca-5fb2-45c3-8b07-ba0b78d7fdef tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:48.057113 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-fdf4e9ca-5fb2-45c3-8b07-ba0b78d7fdef tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:48.059602 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-fdf4e9ca-5fb2-45c3-8b07-ba0b78d7fdef tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1728 microversion: 2.20 time: 0.210010 May 23 16:54:48.060902 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 381/789] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:47 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1728 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:49.078485 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-0e266577-5ba8-4d45-b9b1-58914e7b0cd6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:49.084436 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-0e266577-5ba8-4d45-b9b1-58914e7b0cd6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:49.086688 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0e266577-5ba8-4d45-b9b1-58914e7b0cd6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:49.087150 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0e266577-5ba8-4d45-b9b1-58914e7b0cd6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:49.087938 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0e266577-5ba8-4d45-b9b1-58914e7b0cd6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:49.088415 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0e266577-5ba8-4d45-b9b1-58914e7b0cd6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:49.228867 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-0e266577-5ba8-4d45-b9b1-58914e7b0cd6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:49.237647 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-0e266577-5ba8-4d45-b9b1-58914e7b0cd6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:49.239165 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-0e266577-5ba8-4d45-b9b1-58914e7b0cd6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:49.240487 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-0e266577-5ba8-4d45-b9b1-58914e7b0cd6 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1728 microversion: 2.20 time: 0.166299 May 23 16:54:49.241059 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 409/790] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:49 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:50.260210 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ce29992e-523b-491d-8a95-7a56b1086797 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:50.260884 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ce29992e-523b-491d-8a95-7a56b1086797 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:50.269858 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ce29992e-523b-491d-8a95-7a56b1086797 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:50.270312 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ce29992e-523b-491d-8a95-7a56b1086797 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:50.271101 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ce29992e-523b-491d-8a95-7a56b1086797 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:50.271546 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ce29992e-523b-491d-8a95-7a56b1086797 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:50.431524 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ce29992e-523b-491d-8a95-7a56b1086797 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:50.441261 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ce29992e-523b-491d-8a95-7a56b1086797 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:50.442979 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ce29992e-523b-491d-8a95-7a56b1086797 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:50.444342 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ce29992e-523b-491d-8a95-7a56b1086797 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1728 microversion: 2.20 time: 0.188878 May 23 16:54:50.455184 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 382/791] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:50 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:51.462065 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-4950f756-c2ae-4c33-8da4-2d5891ecf0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:51.462697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-4950f756-c2ae-4c33-8da4-2d5891ecf0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:51.469843 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4950f756-c2ae-4c33-8da4-2d5891ecf0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:51.470238 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4950f756-c2ae-4c33-8da4-2d5891ecf0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:51.470991 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4950f756-c2ae-4c33-8da4-2d5891ecf0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:51.471460 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4950f756-c2ae-4c33-8da4-2d5891ecf0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:51.607529 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-4950f756-c2ae-4c33-8da4-2d5891ecf0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:51.616051 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-4950f756-c2ae-4c33-8da4-2d5891ecf0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:51.617585 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-4950f756-c2ae-4c33-8da4-2d5891ecf0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:51.618753 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-4950f756-c2ae-4c33-8da4-2d5891ecf0ee tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1728 microversion: 2.20 time: 0.160817 May 23 16:54:51.619314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 410/792] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:51 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:52.638135 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-b5560485-02f5-40b7-9f94-4253fba7126c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:52.638723 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-b5560485-02f5-40b7-9f94-4253fba7126c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:52.645606 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b5560485-02f5-40b7-9f94-4253fba7126c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:52.652443 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b5560485-02f5-40b7-9f94-4253fba7126c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:52.652443 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b5560485-02f5-40b7-9f94-4253fba7126c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:52.652443 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b5560485-02f5-40b7-9f94-4253fba7126c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:52.783607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b5560485-02f5-40b7-9f94-4253fba7126c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:52.792138 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b5560485-02f5-40b7-9f94-4253fba7126c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:52.794978 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b5560485-02f5-40b7-9f94-4253fba7126c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:52.796285 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-b5560485-02f5-40b7-9f94-4253fba7126c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1728 microversion: 2.20 time: 0.162760 May 23 16:54:52.800582 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 383/793] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:52 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:53.816772 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-0f0b29ce-6336-4fba-ac47-c715d3d09083 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:53.817387 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-0f0b29ce-6336-4fba-ac47-c715d3d09083 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:53.823898 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0f0b29ce-6336-4fba-ac47-c715d3d09083 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:53.824372 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0f0b29ce-6336-4fba-ac47-c715d3d09083 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:53.825923 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0f0b29ce-6336-4fba-ac47-c715d3d09083 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:53.826354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0f0b29ce-6336-4fba-ac47-c715d3d09083 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:53.967527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-0f0b29ce-6336-4fba-ac47-c715d3d09083 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:53.975749 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-0f0b29ce-6336-4fba-ac47-c715d3d09083 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:53.977309 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-0f0b29ce-6336-4fba-ac47-c715d3d09083 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:53.978506 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-0f0b29ce-6336-4fba-ac47-c715d3d09083 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1728 microversion: 2.20 time: 0.165642 May 23 16:54:53.979151 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 411/794] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:53 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:54.998080 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-239dbb99-8cd8-402d-b84f-e84a90b9ee1a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:54.998690 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-239dbb99-8cd8-402d-b84f-e84a90b9ee1a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:55.004970 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-239dbb99-8cd8-402d-b84f-e84a90b9ee1a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:55.005425 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-239dbb99-8cd8-402d-b84f-e84a90b9ee1a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:55.006209 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-239dbb99-8cd8-402d-b84f-e84a90b9ee1a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:55.006651 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-239dbb99-8cd8-402d-b84f-e84a90b9ee1a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:55.022204 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:54:55.163814 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-239dbb99-8cd8-402d-b84f-e84a90b9ee1a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:55.179302 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-239dbb99-8cd8-402d-b84f-e84a90b9ee1a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:55.181367 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-239dbb99-8cd8-402d-b84f-e84a90b9ee1a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:55.182835 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-239dbb99-8cd8-402d-b84f-e84a90b9ee1a tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1728 microversion: 2.20 time: 0.188839 May 23 16:54:55.184060 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 384/795] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:54 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:55.494381 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-4038e03d-aec9-4ff8-ab96-98a0b5fa0fc1 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:55.495059 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-4038e03d-aec9-4ff8-ab96-98a0b5fa0fc1 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:55.502595 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4038e03d-aec9-4ff8-ab96-98a0b5fa0fc1 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:55.503194 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4038e03d-aec9-4ff8-ab96-98a0b5fa0fc1 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:55.504802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4038e03d-aec9-4ff8-ab96-98a0b5fa0fc1 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:55.509087 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4038e03d-aec9-4ff8-ab96-98a0b5fa0fc1 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:55.542269 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-4038e03d-aec9-4ff8-ab96-98a0b5fa0fc1 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/ips" status: 200 len: 144 microversion: 2.1 time: 0.051760 May 23 16:54:55.662365 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 412/796] 10.222.0.74 () {58 vars in 1247 bytes} [Mon May 23 16:54:55 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/ips => generated 144 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:54:56.235957 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-fa4bf5ae-94a8-4f94-a885-80092e41b2bf tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:56.235957 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-fa4bf5ae-94a8-4f94-a885-80092e41b2bf tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:56.235957 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fa4bf5ae-94a8-4f94-a885-80092e41b2bf tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:56.235957 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fa4bf5ae-94a8-4f94-a885-80092e41b2bf tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:56.236806 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fa4bf5ae-94a8-4f94-a885-80092e41b2bf tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:56.236806 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fa4bf5ae-94a8-4f94-a885-80092e41b2bf tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:56.400000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-fa4bf5ae-94a8-4f94-a885-80092e41b2bf tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:56.409304 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-fa4bf5ae-94a8-4f94-a885-80092e41b2bf tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:56.410816 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-fa4bf5ae-94a8-4f94-a885-80092e41b2bf tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:56.412000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-fa4bf5ae-94a8-4f94-a885-80092e41b2bf tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1728 microversion: 2.20 time: 0.212729 May 23 16:54:56.423406 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 385/797] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:56 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1728 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:57.430721 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-8bd52a1d-e9dc-434f-af35-a801ba6bbb7e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:57.431334 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-8bd52a1d-e9dc-434f-af35-a801ba6bbb7e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:57.438563 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8bd52a1d-e9dc-434f-af35-a801ba6bbb7e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:57.445423 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8bd52a1d-e9dc-434f-af35-a801ba6bbb7e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:57.445423 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8bd52a1d-e9dc-434f-af35-a801ba6bbb7e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:57.445423 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8bd52a1d-e9dc-434f-af35-a801ba6bbb7e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:57.589147 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-8bd52a1d-e9dc-434f-af35-a801ba6bbb7e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:57.591201 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-8bd52a1d-e9dc-434f-af35-a801ba6bbb7e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:57.592959 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-8bd52a1d-e9dc-434f-af35-a801ba6bbb7e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:57.594174 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-8bd52a1d-e9dc-434f-af35-a801ba6bbb7e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1728 microversion: 2.20 time: 0.167367 May 23 16:54:57.594734 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 413/798] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:57 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:58.613557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-74cc4c91-0282-49a8-9a29-8cce90a9776d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:58.614209 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-74cc4c91-0282-49a8-9a29-8cce90a9776d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:58.620986 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-74cc4c91-0282-49a8-9a29-8cce90a9776d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:58.621445 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-74cc4c91-0282-49a8-9a29-8cce90a9776d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:58.622221 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-74cc4c91-0282-49a8-9a29-8cce90a9776d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:58.622663 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-74cc4c91-0282-49a8-9a29-8cce90a9776d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:58.754680 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-74cc4c91-0282-49a8-9a29-8cce90a9776d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:58.763104 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-74cc4c91-0282-49a8-9a29-8cce90a9776d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:58.764650 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-74cc4c91-0282-49a8-9a29-8cce90a9776d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:58.765820 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-74cc4c91-0282-49a8-9a29-8cce90a9776d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1728 microversion: 2.20 time: 0.156187 May 23 16:54:58.766396 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 386/799] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:58 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:54:59.742276 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-51ec3d20-0222-4a04-af87-31360e3245fa tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a50f68ad-4a0e-4f7b-8181-ac9f18098521"}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:54:59.743384 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-51ec3d20-0222-4a04-af87-31360e3245fa tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:59.749945 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-51ec3d20-0222-4a04-af87-31360e3245fa tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:59.750391 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-51ec3d20-0222-4a04-af87-31360e3245fa tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:59.751150 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-51ec3d20-0222-4a04-af87-31360e3245fa tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:59.751583 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-51ec3d20-0222-4a04-af87-31360e3245fa tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:59.783478 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-3caf0e5e-5a7b-4239-ba20-51b8d075d747 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:54:59.784104 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-3caf0e5e-5a7b-4239-ba20-51b8d075d747 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:54:59.790753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3caf0e5e-5a7b-4239-ba20-51b8d075d747 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:59.791211 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3caf0e5e-5a7b-4239-ba20-51b8d075d747 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:59.791995 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3caf0e5e-5a7b-4239-ba20-51b8d075d747 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:54:59.792468 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3caf0e5e-5a7b-4239-ba20-51b8d075d747 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:54:59.921061 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-3caf0e5e-5a7b-4239-ba20-51b8d075d747 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:59.929911 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-3caf0e5e-5a7b-4239-ba20-51b8d075d747 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:59.931443 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-3caf0e5e-5a7b-4239-ba20-51b8d075d747 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:54:59.932659 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-3caf0e5e-5a7b-4239-ba20-51b8d075d747 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1728 microversion: 2.20 time: 0.153032 May 23 16:54:59.933233 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 387/800] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:54:59 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:55:00.951816 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-138e1b40-d504-4c21-8e0c-8b90e5b3b80c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:00.952488 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-138e1b40-d504-4c21-8e0c-8b90e5b3b80c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:00.959126 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-138e1b40-d504-4c21-8e0c-8b90e5b3b80c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:00.959584 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-138e1b40-d504-4c21-8e0c-8b90e5b3b80c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:00.960391 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-138e1b40-d504-4c21-8e0c-8b90e5b3b80c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:00.960839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-138e1b40-d504-4c21-8e0c-8b90e5b3b80c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:01.087338 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-138e1b40-d504-4c21-8e0c-8b90e5b3b80c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:01.095321 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-138e1b40-d504-4c21-8e0c-8b90e5b3b80c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:01.096871 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-138e1b40-d504-4c21-8e0c-8b90e5b3b80c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:01.098038 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-138e1b40-d504-4c21-8e0c-8b90e5b3b80c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1728 microversion: 2.20 time: 0.150545 May 23 16:55:01.098611 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 388/801] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:55:00 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:55:02.116511 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-67ca5328-4cf0-4866-ac00-cd25a54611a0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:02.117203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-67ca5328-4cf0-4866-ac00-cd25a54611a0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:02.123951 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-67ca5328-4cf0-4866-ac00-cd25a54611a0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:02.124510 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-67ca5328-4cf0-4866-ac00-cd25a54611a0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:02.125268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-67ca5328-4cf0-4866-ac00-cd25a54611a0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:02.125758 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-67ca5328-4cf0-4866-ac00-cd25a54611a0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:02.260211 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-67ca5328-4cf0-4866-ac00-cd25a54611a0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:02.279293 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-67ca5328-4cf0-4866-ac00-cd25a54611a0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:02.284726 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-67ca5328-4cf0-4866-ac00-cd25a54611a0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:02.286053 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-67ca5328-4cf0-4866-ac00-cd25a54611a0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1728 microversion: 2.20 time: 0.173446 May 23 16:55:02.286671 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 389/802] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:55:02 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:55:02.640442 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-555ccdbd-42ad-479d-a104-7856f668639a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1518254299", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-877096425", "security_groups": [{"name": "tempest-secgroup-smoke-1810518830"}], "block_device_mapping_v2": [{"uuid": "906509eb-7430-45a0-9d8e-d762e5df47e3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "919d5a7a-cf43-4ee4-a633-f9112228c533"}]}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:55:02.755024 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.network.neutron [None req-555ccdbd-42ad-479d-a104-7856f668639a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] validate_networks() for [('919d5a7a-cf43-4ee4-a633-f9112228c533', None, None, None, None, None)] {{(pid=124714) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 16:55:03.125779 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-555ccdbd-42ad-479d-a104-7856f668639a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Flavor limits 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 16:55:03.126358 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-555ccdbd-42ad-479d-a104-7856f668639a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Image limits 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 16:55:03.126685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-555ccdbd-42ad-479d-a104-7856f668639a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Flavor pref 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 16:55:03.127100 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-555ccdbd-42ad-479d-a104-7856f668639a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Image pref 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 16:55:03.127522 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-555ccdbd-42ad-479d-a104-7856f668639a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 16:55:03.137331 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-555ccdbd-42ad-479d-a104-7856f668639a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:03.137786 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-555ccdbd-42ad-479d-a104-7856f668639a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:03.138593 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-555ccdbd-42ad-479d-a104-7856f668639a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:03.139041 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-555ccdbd-42ad-479d-a104-7856f668639a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:03.155647 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-555ccdbd-42ad-479d-a104-7856f668639a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Getting quotas for project 8d09d9819e564152aacc661d1da68fcd. Resources: {'cores', 'instances', 'ram'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:55:03.159605 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-555ccdbd-42ad-479d-a104-7856f668639a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Getting quotas for user 2aa01ac54736475188dbc47f3cda4de1 and project 8d09d9819e564152aacc661d1da68fcd. Resources: {'cores', 'instances', 'ram'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:55:03.217635 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-555ccdbd-42ad-479d-a104-7856f668639a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Going to run 1 instances... {{(pid=124714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 16:55:03.219781 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-555ccdbd-42ad-479d-a104-7856f668639a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='906509eb-7430-45a0-9d8e-d762e5df47e3',volume_size=None,volume_type=None)] {{(pid=124714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 16:55:03.518954 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=52 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:03.608459 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-555ccdbd-42ad-479d-a104-7856f668639a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.971809 May 23 16:55:03.614607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 390/803] 10.222.0.74 () {60 vars in 1146 bytes} [Mon May 23 16:55:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 16:55:03.614770 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-1fa59a08-adbb-4c74-a72e-7babe060992f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:03.615325 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-1fa59a08-adbb-4c74-a72e-7babe060992f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:03.623488 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1fa59a08-adbb-4c74-a72e-7babe060992f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:03.623980 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1fa59a08-adbb-4c74-a72e-7babe060992f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:03.625731 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1fa59a08-adbb-4c74-a72e-7babe060992f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:03.625731 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1fa59a08-adbb-4c74-a72e-7babe060992f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:03.771743 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-1fa59a08-adbb-4c74-a72e-7babe060992f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:03.783848 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-1fa59a08-adbb-4c74-a72e-7babe060992f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:03.787259 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-1fa59a08-adbb-4c74-a72e-7babe060992f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:03.788497 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-1fa59a08-adbb-4c74-a72e-7babe060992f tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1728 microversion: 2.20 time: 0.177521 May 23 16:55:03.789071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 391/804] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:55:03 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:55:03.798767 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-064741ed-d311-4f20-9a34-acf9cfc08b13 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:03.799390 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-064741ed-d311-4f20-9a34-acf9cfc08b13 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:03.863147 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-064741ed-d311-4f20-9a34-acf9cfc08b13 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:03.870417 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-064741ed-d311-4f20-9a34-acf9cfc08b13 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1094 microversion: 2.1 time: 0.080215 May 23 16:55:03.871014 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 392/805] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:03 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:04.445743 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-51ec3d20-0222-4a04-af87-31360e3245fa tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "POST /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.707185 May 23 16:55:04.446378 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 414/806] 10.222.0.74 () {60 vars in 1322 bytes} [Mon May 23 16:54:59 2022] POST /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-volume_attachments => generated 194 bytes in 4709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:55:04.807602 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-2f2ca578-5691-49d3-aaf2-3e56a323d836 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:04.808161 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-2f2ca578-5691-49d3-aaf2-3e56a323d836 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:04.816258 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2f2ca578-5691-49d3-aaf2-3e56a323d836 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:04.819572 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2f2ca578-5691-49d3-aaf2-3e56a323d836 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:04.819572 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2f2ca578-5691-49d3-aaf2-3e56a323d836 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:04.819572 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2f2ca578-5691-49d3-aaf2-3e56a323d836 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:04.889943 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-4bc6eb5b-a1b6-4aff-add7-ec9984ea2e42 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:04.890680 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-4bc6eb5b-a1b6-4aff-add7-ec9984ea2e42 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:04.898130 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4bc6eb5b-a1b6-4aff-add7-ec9984ea2e42 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:04.899007 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4bc6eb5b-a1b6-4aff-add7-ec9984ea2e42 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:04.899270 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4bc6eb5b-a1b6-4aff-add7-ec9984ea2e42 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:04.899755 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4bc6eb5b-a1b6-4aff-add7-ec9984ea2e42 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:04.904281 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:04.977865 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-4bc6eb5b-a1b6-4aff-add7-ec9984ea2e42 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:04.984375 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-2f2ca578-5691-49d3-aaf2-3e56a323d836 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:04.986765 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-4bc6eb5b-a1b6-4aff-add7-ec9984ea2e42 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1144 microversion: 2.1 time: 0.102097 May 23 16:55:04.987357 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 415/807] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:04 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1144 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:55:04.992768 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-2f2ca578-5691-49d3-aaf2-3e56a323d836 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:04.994469 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-2f2ca578-5691-49d3-aaf2-3e56a323d836 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:04.995720 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-2f2ca578-5691-49d3-aaf2-3e56a323d836 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1728 microversion: 2.20 time: 0.192319 May 23 16:55:04.996375 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 393/808] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:55:04 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1728 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:55:06.004341 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-caa064f2-b13d-4b18-a2c8-17b5bf957f76 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:06.004893 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-caa064f2-b13d-4b18-a2c8-17b5bf957f76 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:06.011865 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-caa064f2-b13d-4b18-a2c8-17b5bf957f76 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:06.014945 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-caa064f2-b13d-4b18-a2c8-17b5bf957f76 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:06.014945 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-caa064f2-b13d-4b18-a2c8-17b5bf957f76 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:06.014945 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-caa064f2-b13d-4b18-a2c8-17b5bf957f76 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:06.015359 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-d5e8269b-d11a-4d8e-b140-4d4e167011ad tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:06.015802 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-d5e8269b-d11a-4d8e-b140-4d4e167011ad tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:06.022142 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d5e8269b-d11a-4d8e-b140-4d4e167011ad tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:06.022598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d5e8269b-d11a-4d8e-b140-4d4e167011ad tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:06.023381 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d5e8269b-d11a-4d8e-b140-4d4e167011ad tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:06.023825 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d5e8269b-d11a-4d8e-b140-4d4e167011ad tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:06.103923 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-caa064f2-b13d-4b18-a2c8-17b5bf957f76 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:06.118789 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-caa064f2-b13d-4b18-a2c8-17b5bf957f76 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1210 microversion: 2.1 time: 0.118536 May 23 16:55:06.119691 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 416/809] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:05 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1210 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:06.180768 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-d5e8269b-d11a-4d8e-b140-4d4e167011ad tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:06.192008 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-d5e8269b-d11a-4d8e-b140-4d4e167011ad tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:06.193864 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-d5e8269b-d11a-4d8e-b140-4d4e167011ad tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:06.195837 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-d5e8269b-d11a-4d8e-b140-4d4e167011ad tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1728 microversion: 2.20 time: 0.185731 May 23 16:55:06.196985 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 394/810] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:55:06 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:55:07.141437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a1b7f84a-4ed0-4b7f-a6cf-350d234d17fd tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:07.142226 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a1b7f84a-4ed0-4b7f-a6cf-350d234d17fd tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:07.151266 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a1b7f84a-4ed0-4b7f-a6cf-350d234d17fd tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:07.151727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a1b7f84a-4ed0-4b7f-a6cf-350d234d17fd tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:07.153915 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a1b7f84a-4ed0-4b7f-a6cf-350d234d17fd tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:07.154422 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a1b7f84a-4ed0-4b7f-a6cf-350d234d17fd tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:07.221864 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-a88b18c9-562c-40ad-82ee-30ec424b01ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:07.222682 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-a88b18c9-562c-40ad-82ee-30ec424b01ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:07.231542 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a88b18c9-562c-40ad-82ee-30ec424b01ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:07.235886 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a88b18c9-562c-40ad-82ee-30ec424b01ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:07.235886 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a88b18c9-562c-40ad-82ee-30ec424b01ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:07.235886 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a88b18c9-562c-40ad-82ee-30ec424b01ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:07.336651 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a1b7f84a-4ed0-4b7f-a6cf-350d234d17fd tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:07.349949 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a1b7f84a-4ed0-4b7f-a6cf-350d234d17fd tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1278 microversion: 2.1 time: 0.215629 May 23 16:55:07.350541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 417/811] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:07 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1278 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:07.416540 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-a88b18c9-562c-40ad-82ee-30ec424b01ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:07.425159 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-a88b18c9-562c-40ad-82ee-30ec424b01ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:07.426676 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-a88b18c9-562c-40ad-82ee-30ec424b01ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:07.427846 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-a88b18c9-562c-40ad-82ee-30ec424b01ae tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1728 microversion: 2.20 time: 0.210769 May 23 16:55:07.428438 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 395/812] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:55:07 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1728 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:55:07.486756 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-6c9e728e-4868-4191-a6e0-f40f39298fab req-7fb54807-21c7-4a40-900b-252fb6d5eb6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e461f9e-4217-45ec-bf28-2a70f7ca0f82", "tag": "9c208ee4-0165-4731-ad35-9eb054957a82"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:55:07.500033 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-6c9e728e-4868-4191-a6e0-f40f39298fab req-7fb54807-21c7-4a40-900b-252fb6d5eb6e service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:07.500964 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-6c9e728e-4868-4191-a6e0-f40f39298fab req-7fb54807-21c7-4a40-900b-252fb6d5eb6e service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:07.515742 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-6c9e728e-4868-4191-a6e0-f40f39298fab req-7fb54807-21c7-4a40-900b-252fb6d5eb6e service nova] Creating event network-changed:9c208ee4-0165-4731-ad35-9eb054957a82 for instance 5e461f9e-4217-45ec-bf28-2a70f7ca0f82 on hv-cinder-83925 May 23 16:55:07.521179 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-6c9e728e-4868-4191-a6e0-f40f39298fab req-7fb54807-21c7-4a40-900b-252fb6d5eb6e service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043625 May 23 16:55:07.525172 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 418/813] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:55:07.817379 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-62c6ddb5-bbdb-4a2a-9c87-d264e32d608d req-e4a93465-9101-4b2a-81f3-cc6eac21300b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa18b171-8b37-4fcc-b7e9-e50494e967af", "name": "network-vif-plugged", "status": "completed", "tag": "7fc3fb4c-c736-453c-a8e0-bd34a6233442"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:55:07.827311 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-62c6ddb5-bbdb-4a2a-9c87-d264e32d608d req-e4a93465-9101-4b2a-81f3-cc6eac21300b service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:07.833103 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-62c6ddb5-bbdb-4a2a-9c87-d264e32d608d req-e4a93465-9101-4b2a-81f3-cc6eac21300b service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:07.839437 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-62c6ddb5-bbdb-4a2a-9c87-d264e32d608d req-e4a93465-9101-4b2a-81f3-cc6eac21300b service nova] Creating event network-vif-plugged:7fc3fb4c-c736-453c-a8e0-bd34a6233442 for instance fa18b171-8b37-4fcc-b7e9-e50494e967af on hv-cinder-83925 May 23 16:55:07.845450 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-62c6ddb5-bbdb-4a2a-9c87-d264e32d608d req-e4a93465-9101-4b2a-81f3-cc6eac21300b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032529 May 23 16:55:07.846079 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 396/814] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:55:08.371560 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-100a939b-8ed1-46fe-b56b-ad5e83601fc1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:08.371560 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-100a939b-8ed1-46fe-b56b-ad5e83601fc1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:08.376160 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-100a939b-8ed1-46fe-b56b-ad5e83601fc1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:08.376749 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-100a939b-8ed1-46fe-b56b-ad5e83601fc1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:08.377529 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-100a939b-8ed1-46fe-b56b-ad5e83601fc1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:08.378081 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-100a939b-8ed1-46fe-b56b-ad5e83601fc1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:08.447393 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-a3f07f4c-3bf0-4064-8336-627099d87368 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:08.448206 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-a3f07f4c-3bf0-4064-8336-627099d87368 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:08.455116 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a3f07f4c-3bf0-4064-8336-627099d87368 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:08.455638 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a3f07f4c-3bf0-4064-8336-627099d87368 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:08.456814 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a3f07f4c-3bf0-4064-8336-627099d87368 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:08.457342 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a3f07f4c-3bf0-4064-8336-627099d87368 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:08.549059 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-100a939b-8ed1-46fe-b56b-ad5e83601fc1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:08.556566 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-100a939b-8ed1-46fe-b56b-ad5e83601fc1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1278 microversion: 2.1 time: 0.193183 May 23 16:55:08.557138 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 419/815] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:08 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1278 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:08.615436 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-a3f07f4c-3bf0-4064-8336-627099d87368 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:08.623610 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-a3f07f4c-3bf0-4064-8336-627099d87368 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:08.625101 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-a3f07f4c-3bf0-4064-8336-627099d87368 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:08.626273 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-a3f07f4c-3bf0-4064-8336-627099d87368 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1728 microversion: 2.20 time: 0.183870 May 23 16:55:08.626843 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 397/816] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:55:08 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1728 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:55:09.574348 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-197643ac-6102-42c8-88dc-0334288f123f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:09.574962 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-197643ac-6102-42c8-88dc-0334288f123f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:09.581355 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-197643ac-6102-42c8-88dc-0334288f123f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:09.581804 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-197643ac-6102-42c8-88dc-0334288f123f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:09.582674 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-197643ac-6102-42c8-88dc-0334288f123f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:09.583122 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-197643ac-6102-42c8-88dc-0334288f123f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:09.644286 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-83e21644-1f11-45eb-9310-8aa91867ce5d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:09.644939 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-83e21644-1f11-45eb-9310-8aa91867ce5d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:09.651352 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-83e21644-1f11-45eb-9310-8aa91867ce5d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:09.651940 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-83e21644-1f11-45eb-9310-8aa91867ce5d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:09.653238 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-83e21644-1f11-45eb-9310-8aa91867ce5d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:09.653678 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-83e21644-1f11-45eb-9310-8aa91867ce5d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:09.744916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-197643ac-6102-42c8-88dc-0334288f123f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:09.754308 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-197643ac-6102-42c8-88dc-0334288f123f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1278 microversion: 2.1 time: 0.183875 May 23 16:55:09.755044 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 420/817] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:09 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1278 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:09.806471 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-83e21644-1f11-45eb-9310-8aa91867ce5d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:09.814482 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-83e21644-1f11-45eb-9310-8aa91867ce5d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:09.815994 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-83e21644-1f11-45eb-9310-8aa91867ce5d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:09.817199 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-83e21644-1f11-45eb-9310-8aa91867ce5d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1728 microversion: 2.20 time: 0.176780 May 23 16:55:09.817760 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 398/818] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:55:09 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:55:10.771004 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-f129b67d-f38c-492b-8815-5345552067f7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:10.771630 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-f129b67d-f38c-492b-8815-5345552067f7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:10.778227 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f129b67d-f38c-492b-8815-5345552067f7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:10.778824 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f129b67d-f38c-492b-8815-5345552067f7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:10.779554 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f129b67d-f38c-492b-8815-5345552067f7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:10.780005 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f129b67d-f38c-492b-8815-5345552067f7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:10.837634 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-6909525b-8035-45f4-bd3c-cd75b50ba3f2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:10.838531 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-6909525b-8035-45f4-bd3c-cd75b50ba3f2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:10.846450 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6909525b-8035-45f4-bd3c-cd75b50ba3f2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:10.852218 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6909525b-8035-45f4-bd3c-cd75b50ba3f2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:10.852218 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6909525b-8035-45f4-bd3c-cd75b50ba3f2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:10.852218 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6909525b-8035-45f4-bd3c-cd75b50ba3f2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:10.949839 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f129b67d-f38c-492b-8815-5345552067f7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:10.958030 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-f129b67d-f38c-492b-8815-5345552067f7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1278 microversion: 2.1 time: 0.190865 May 23 16:55:10.958870 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 421/819] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:10 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1278 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:55:11.010778 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-6909525b-8035-45f4-bd3c-cd75b50ba3f2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:11.019055 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-6909525b-8035-45f4-bd3c-cd75b50ba3f2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:11.020622 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-6909525b-8035-45f4-bd3c-cd75b50ba3f2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:11.033265 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-6909525b-8035-45f4-bd3c-cd75b50ba3f2 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1728 microversion: 2.20 time: 0.190526 May 23 16:55:11.033265 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 399/820] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:55:10 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1728 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 16:55:11.971834 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c96586cb-23d3-46ff-9845-87ff497824ac tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:11.972797 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-c96586cb-23d3-46ff-9845-87ff497824ac tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:11.974887 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-1ce5a4a3-fcab-4ffb-8b06-a3e5a0324000 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:11.975533 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-1ce5a4a3-fcab-4ffb-8b06-a3e5a0324000 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:11.979390 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c96586cb-23d3-46ff-9845-87ff497824ac tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:11.979847 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c96586cb-23d3-46ff-9845-87ff497824ac tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:11.980647 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c96586cb-23d3-46ff-9845-87ff497824ac tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:11.981275 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c96586cb-23d3-46ff-9845-87ff497824ac tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:11.982127 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1ce5a4a3-fcab-4ffb-8b06-a3e5a0324000 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:11.982573 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1ce5a4a3-fcab-4ffb-8b06-a3e5a0324000 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:11.983338 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1ce5a4a3-fcab-4ffb-8b06-a3e5a0324000 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:11.983771 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1ce5a4a3-fcab-4ffb-8b06-a3e5a0324000 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:12.011671 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-c96586cb-23d3-46ff-9845-87ff497824ac tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043851 May 23 16:55:12.013062 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 422/821] 10.222.0.74 () {58 vars in 1301 bytes} [Mon May 23 16:55:11 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:55:12.022747 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-4c074761-e8c3-41bf-b86d-f27096d1c552 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:12.023299 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-4c074761-e8c3-41bf-b86d-f27096d1c552 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:12.029548 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4c074761-e8c3-41bf-b86d-f27096d1c552 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:12.029997 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4c074761-e8c3-41bf-b86d-f27096d1c552 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:12.030761 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4c074761-e8c3-41bf-b86d-f27096d1c552 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:12.031194 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4c074761-e8c3-41bf-b86d-f27096d1c552 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:12.060610 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-4c074761-e8c3-41bf-b86d-f27096d1c552 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-volume_attachments/a50f68ad-4a0e-4f7b-8181-ac9f18098521" status: 200 len: 194 microversion: 2.1 time: 0.041593 May 23 16:55:12.061200 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 423/822] 10.222.0.74 () {58 vars in 1412 bytes} [Mon May 23 16:55:12 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-volume_attachments/a50f68ad-4a0e-4f7b-8181-ac9f18098521 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:55:12.066392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-8373f26a-b748-4e92-bb77-0863ae10004d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:12.067020 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-8373f26a-b748-4e92-bb77-0863ae10004d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:12.079746 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8373f26a-b748-4e92-bb77-0863ae10004d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:12.080200 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8373f26a-b748-4e92-bb77-0863ae10004d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:12.081001 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8373f26a-b748-4e92-bb77-0863ae10004d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:12.081438 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8373f26a-b748-4e92-bb77-0863ae10004d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:12.120572 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-1ce5a4a3-fcab-4ffb-8b06-a3e5a0324000 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:12.129531 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-1ce5a4a3-fcab-4ffb-8b06-a3e5a0324000 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1278 microversion: 2.1 time: 0.158514 May 23 16:55:12.130225 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 400/823] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:11 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:55:12.240003 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-8373f26a-b748-4e92-bb77-0863ae10004d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:12.253877 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-8373f26a-b748-4e92-bb77-0863ae10004d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:12.255408 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-8373f26a-b748-4e92-bb77-0863ae10004d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:12.256625 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-8373f26a-b748-4e92-bb77-0863ae10004d tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1715 microversion: 2.20 time: 0.194479 May 23 16:55:12.257191 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 424/824] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:55:12 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1715 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:55:13.147438 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-8c9d4915-118b-42d3-a026-455bd6bb637d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:13.147982 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-8c9d4915-118b-42d3-a026-455bd6bb637d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:13.150414 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=2 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:13.155355 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8c9d4915-118b-42d3-a026-455bd6bb637d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:13.155820 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8c9d4915-118b-42d3-a026-455bd6bb637d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:13.156673 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8c9d4915-118b-42d3-a026-455bd6bb637d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:13.157117 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8c9d4915-118b-42d3-a026-455bd6bb637d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:13.289773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8c9d4915-118b-42d3-a026-455bd6bb637d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:13.297990 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-8c9d4915-118b-42d3-a026-455bd6bb637d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1266 microversion: 2.1 time: 0.154558 May 23 16:55:13.298548 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 401/825] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:13 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:14.317401 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7e0be277-f88c-4e95-a16e-527c416080d1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:14.317950 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-7e0be277-f88c-4e95-a16e-527c416080d1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:14.324611 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7e0be277-f88c-4e95-a16e-527c416080d1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:14.326171 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7e0be277-f88c-4e95-a16e-527c416080d1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:14.326951 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7e0be277-f88c-4e95-a16e-527c416080d1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:14.327409 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7e0be277-f88c-4e95-a16e-527c416080d1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:14.458205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-7e0be277-f88c-4e95-a16e-527c416080d1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:14.466030 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-7e0be277-f88c-4e95-a16e-527c416080d1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1266 microversion: 2.1 time: 0.154395 May 23 16:55:14.466592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 425/826] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:14 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:14.686663 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-d4b93d81-4b93-4e7d-aa95-d68fed7e4fac tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed97a5c4-f8f4-444a-9ddb-d9637e59f091"}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:55:14.687751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-d4b93d81-4b93-4e7d-aa95-d68fed7e4fac tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:14.689652 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=8 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:14.694890 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d4b93d81-4b93-4e7d-aa95-d68fed7e4fac tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:14.695386 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d4b93d81-4b93-4e7d-aa95-d68fed7e4fac tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:14.696167 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d4b93d81-4b93-4e7d-aa95-d68fed7e4fac tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:14.696649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d4b93d81-4b93-4e7d-aa95-d68fed7e4fac tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:14.889702 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:15.422743 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-d4b93d81-4b93-4e7d-aa95-d68fed7e4fac tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "POST /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.740578 May 23 16:55:15.423395 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 402/827] 10.222.0.74 () {60 vars in 1322 bytes} [Mon May 23 16:55:14 2022] POST /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-volume_attachments => generated 194 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:55:15.482863 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-ee89100f-f25c-40f2-bb52-1f46e9c079ac tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:15.483519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-ee89100f-f25c-40f2-bb52-1f46e9c079ac tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:15.485910 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=38 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:15.490779 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ee89100f-f25c-40f2-bb52-1f46e9c079ac tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:15.499227 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ee89100f-f25c-40f2-bb52-1f46e9c079ac tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:15.499227 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ee89100f-f25c-40f2-bb52-1f46e9c079ac tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:15.499227 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-ee89100f-f25c-40f2-bb52-1f46e9c079ac tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:15.630498 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-ee89100f-f25c-40f2-bb52-1f46e9c079ac tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:15.638674 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-ee89100f-f25c-40f2-bb52-1f46e9c079ac tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1266 microversion: 2.1 time: 0.159651 May 23 16:55:15.639234 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 426/828] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:15 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:16.657503 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-e0155906-b2bf-473e-a878-c4df96c18a97 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:16.658210 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-e0155906-b2bf-473e-a878-c4df96c18a97 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:16.664518 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e0155906-b2bf-473e-a878-c4df96c18a97 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:16.664973 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e0155906-b2bf-473e-a878-c4df96c18a97 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:16.665740 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e0155906-b2bf-473e-a878-c4df96c18a97 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:16.666182 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e0155906-b2bf-473e-a878-c4df96c18a97 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:16.795366 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e0155906-b2bf-473e-a878-c4df96c18a97 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:16.802999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-e0155906-b2bf-473e-a878-c4df96c18a97 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1266 microversion: 2.1 time: 0.151016 May 23 16:55:16.803572 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 403/829] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:16 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:55:17.821026 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-25375581-6741-415d-b3fa-5ddbac238c38 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:17.821560 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-25375581-6741-415d-b3fa-5ddbac238c38 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:17.828287 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-25375581-6741-415d-b3fa-5ddbac238c38 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:17.828773 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-25375581-6741-415d-b3fa-5ddbac238c38 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:17.829541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-25375581-6741-415d-b3fa-5ddbac238c38 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:17.829978 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-25375581-6741-415d-b3fa-5ddbac238c38 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:17.963775 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-25375581-6741-415d-b3fa-5ddbac238c38 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:17.971892 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-25375581-6741-415d-b3fa-5ddbac238c38 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1266 microversion: 2.1 time: 0.154843 May 23 16:55:17.972500 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 427/830] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:17 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:18.989925 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-837cd3df-ed1c-4122-8583-2a9f7f3cc992 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:18.990439 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-837cd3df-ed1c-4122-8583-2a9f7f3cc992 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:18.997893 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-837cd3df-ed1c-4122-8583-2a9f7f3cc992 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:18.998342 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-837cd3df-ed1c-4122-8583-2a9f7f3cc992 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:18.999104 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-837cd3df-ed1c-4122-8583-2a9f7f3cc992 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:18.999541 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-837cd3df-ed1c-4122-8583-2a9f7f3cc992 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:19.127475 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-837cd3df-ed1c-4122-8583-2a9f7f3cc992 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:19.134953 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-837cd3df-ed1c-4122-8583-2a9f7f3cc992 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1266 microversion: 2.1 time: 0.148972 May 23 16:55:19.135523 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 404/831] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:18 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:20.152097 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-3a7bd676-0bf2-4c84-81e4-12c6fbe230c9 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:20.152748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-3a7bd676-0bf2-4c84-81e4-12c6fbe230c9 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:20.159248 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3a7bd676-0bf2-4c84-81e4-12c6fbe230c9 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:20.159702 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3a7bd676-0bf2-4c84-81e4-12c6fbe230c9 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:20.160511 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3a7bd676-0bf2-4c84-81e4-12c6fbe230c9 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:20.160987 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3a7bd676-0bf2-4c84-81e4-12c6fbe230c9 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:20.293301 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-3a7bd676-0bf2-4c84-81e4-12c6fbe230c9 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:20.300690 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-3a7bd676-0bf2-4c84-81e4-12c6fbe230c9 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1266 microversion: 2.1 time: 0.152511 May 23 16:55:20.301257 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 428/832] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:20 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:21.318642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-2094af7f-a84e-44e8-924b-c08964ce1857 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:21.319262 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-2094af7f-a84e-44e8-924b-c08964ce1857 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:21.325952 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2094af7f-a84e-44e8-924b-c08964ce1857 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:21.326401 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2094af7f-a84e-44e8-924b-c08964ce1857 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:21.327170 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2094af7f-a84e-44e8-924b-c08964ce1857 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:21.327609 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2094af7f-a84e-44e8-924b-c08964ce1857 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:21.458716 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-2094af7f-a84e-44e8-924b-c08964ce1857 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:21.466765 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-2094af7f-a84e-44e8-924b-c08964ce1857 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1266 microversion: 2.1 time: 0.152081 May 23 16:55:21.467336 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 405/833] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:21 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:22.484216 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-8ff2b3c2-dbad-4443-bb4f-6ddcad9cac11 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:22.484819 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-8ff2b3c2-dbad-4443-bb4f-6ddcad9cac11 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:22.491396 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8ff2b3c2-dbad-4443-bb4f-6ddcad9cac11 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:22.491855 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8ff2b3c2-dbad-4443-bb4f-6ddcad9cac11 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:22.492661 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8ff2b3c2-dbad-4443-bb4f-6ddcad9cac11 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:22.493107 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-8ff2b3c2-dbad-4443-bb4f-6ddcad9cac11 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:22.624586 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-8ff2b3c2-dbad-4443-bb4f-6ddcad9cac11 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:22.632134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-8ff2b3c2-dbad-4443-bb4f-6ddcad9cac11 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1266 microversion: 2.1 time: 0.152932 May 23 16:55:22.632737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 429/834] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:22 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:23.649731 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-1156cfa6-d842-445c-bdc2-0841d5d58bdc tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:23.650346 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-1156cfa6-d842-445c-bdc2-0841d5d58bdc tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:23.657142 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1156cfa6-d842-445c-bdc2-0841d5d58bdc tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:23.657619 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1156cfa6-d842-445c-bdc2-0841d5d58bdc tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:23.658399 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1156cfa6-d842-445c-bdc2-0841d5d58bdc tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:23.658836 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1156cfa6-d842-445c-bdc2-0841d5d58bdc tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:23.794911 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-851280d5-e0ce-4332-8ff1-0f086f515b69 req-c90892e0-8fe8-478d-91b6-bb71ce4f573e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e461f9e-4217-45ec-bf28-2a70f7ca0f82", "name": "network-vif-plugged", "status": "completed", "tag": "9c208ee4-0165-4731-ad35-9eb054957a82"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:55:23.795431 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-1156cfa6-d842-445c-bdc2-0841d5d58bdc tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:23.803190 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-1156cfa6-d842-445c-bdc2-0841d5d58bdc tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1266 microversion: 2.1 time: 0.157392 May 23 16:55:23.803766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 406/835] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:23 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:23.804497 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-851280d5-e0ce-4332-8ff1-0f086f515b69 req-c90892e0-8fe8-478d-91b6-bb71ce4f573e service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:23.804962 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-851280d5-e0ce-4332-8ff1-0f086f515b69 req-c90892e0-8fe8-478d-91b6-bb71ce4f573e service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:23.816119 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-851280d5-e0ce-4332-8ff1-0f086f515b69 req-c90892e0-8fe8-478d-91b6-bb71ce4f573e service nova] Creating event network-vif-plugged:9c208ee4-0165-4731-ad35-9eb054957a82 for instance 5e461f9e-4217-45ec-bf28-2a70f7ca0f82 on hv-cinder-83925 May 23 16:55:23.825012 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-851280d5-e0ce-4332-8ff1-0f086f515b69 req-c90892e0-8fe8-478d-91b6-bb71ce4f573e service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031493 May 23 16:55:23.825012 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 430/836] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:55:23.970878 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-bf165c93-3fae-4696-904a-72e1fe0ba79c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:23.971858 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-bf165c93-3fae-4696-904a-72e1fe0ba79c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:23.977948 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bf165c93-3fae-4696-904a-72e1fe0ba79c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:23.978393 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bf165c93-3fae-4696-904a-72e1fe0ba79c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:23.979153 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bf165c93-3fae-4696-904a-72e1fe0ba79c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:23.979584 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bf165c93-3fae-4696-904a-72e1fe0ba79c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:24.009976 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-bf165c93-3fae-4696-904a-72e1fe0ba79c tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042987 May 23 16:55:24.010528 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 407/837] 10.222.0.74 () {58 vars in 1301 bytes} [Mon May 23 16:55:23 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:55:24.146331 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a4db35d2-972a-44dd-a8ef-2028b2e125ac tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:24.146914 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a4db35d2-972a-44dd-a8ef-2028b2e125ac tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:24.153847 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a4db35d2-972a-44dd-a8ef-2028b2e125ac tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:24.154297 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a4db35d2-972a-44dd-a8ef-2028b2e125ac tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:24.158240 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a4db35d2-972a-44dd-a8ef-2028b2e125ac tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:24.158240 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a4db35d2-972a-44dd-a8ef-2028b2e125ac tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:24.182812 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a4db35d2-972a-44dd-a8ef-2028b2e125ac tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-volume_attachments/a50f68ad-4a0e-4f7b-8181-ac9f18098521" status: 200 len: 194 microversion: 2.1 time: 0.040911 May 23 16:55:24.183374 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 431/838] 10.222.0.74 () {58 vars in 1412 bytes} [Mon May 23 16:55:24 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-volume_attachments/a50f68ad-4a0e-4f7b-8181-ac9f18098521 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:55:24.193438 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-d563de28-5d20-4290-9352-c461d076aa79 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:24.193983 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-d563de28-5d20-4290-9352-c461d076aa79 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:24.200755 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d563de28-5d20-4290-9352-c461d076aa79 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:24.201090 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d563de28-5d20-4290-9352-c461d076aa79 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:24.201895 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d563de28-5d20-4290-9352-c461d076aa79 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:24.202332 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d563de28-5d20-4290-9352-c461d076aa79 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:24.283441 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.objects.instance [None req-d563de28-5d20-4290-9352-c461d076aa79 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lazy-loading 'services' on Instance uuid de945e1d-3af8-44a5-a5e4-ece874d859d7 {{(pid=124714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:55:24.538184 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-d563de28-5d20-4290-9352-c461d076aa79 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "DELETE /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-volume_attachments/a50f68ad-4a0e-4f7b-8181-ac9f18098521" status: 202 len: 0 microversion: 2.1 time: 0.348638 May 23 16:55:24.538825 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 408/839] 10.222.0.74 () {58 vars in 1415 bytes} [Mon May 23 16:55:24 2022] DELETE /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-volume_attachments/a50f68ad-4a0e-4f7b-8181-ac9f18098521 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:55:24.819750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-9515ce51-eb2c-4585-84c6-44f2517be79b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:24.820389 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-9515ce51-eb2c-4585-84c6-44f2517be79b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:24.827661 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9515ce51-eb2c-4585-84c6-44f2517be79b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:24.828113 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9515ce51-eb2c-4585-84c6-44f2517be79b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:24.828904 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9515ce51-eb2c-4585-84c6-44f2517be79b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:24.829342 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9515ce51-eb2c-4585-84c6-44f2517be79b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:24.956241 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-9515ce51-eb2c-4585-84c6-44f2517be79b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:24.963886 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-9515ce51-eb2c-4585-84c6-44f2517be79b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1266 microversion: 2.1 time: 0.148009 May 23 16:55:24.964482 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 432/840] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:24 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:25.982512 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-1a15a760-6397-415a-ba9f-0988ff3ced67 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:25.983131 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-1a15a760-6397-415a-ba9f-0988ff3ced67 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:25.989757 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1a15a760-6397-415a-ba9f-0988ff3ced67 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:25.990216 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1a15a760-6397-415a-ba9f-0988ff3ced67 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:25.990987 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1a15a760-6397-415a-ba9f-0988ff3ced67 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:25.991439 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1a15a760-6397-415a-ba9f-0988ff3ced67 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:26.123004 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-1a15a760-6397-415a-ba9f-0988ff3ced67 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:26.130832 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-1a15a760-6397-415a-ba9f-0988ff3ced67 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1452 microversion: 2.1 time: 0.153685 May 23 16:55:26.131413 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 409/841] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:25 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:26.147487 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-f6f51b1c-0fa3-4205-9ff4-16073484cfbb tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:26.148106 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-f6f51b1c-0fa3-4205-9ff4-16073484cfbb tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:26.154751 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f6f51b1c-0fa3-4205-9ff4-16073484cfbb tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:26.155208 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f6f51b1c-0fa3-4205-9ff4-16073484cfbb tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:26.158542 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f6f51b1c-0fa3-4205-9ff4-16073484cfbb tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:26.158542 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f6f51b1c-0fa3-4205-9ff4-16073484cfbb tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:26.159130 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=100 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:26.289604 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f6f51b1c-0fa3-4205-9ff4-16073484cfbb tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:26.297168 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-f6f51b1c-0fa3-4205-9ff4-16073484cfbb tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1452 microversion: 2.1 time: 0.153536 May 23 16:55:26.297733 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 433/842] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:26 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:27.763459 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ce1094d9-ec89-469d-91ff-f9c7caf75b3a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:27.764001 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ce1094d9-ec89-469d-91ff-f9c7caf75b3a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:27.770360 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ce1094d9-ec89-469d-91ff-f9c7caf75b3a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:27.770808 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ce1094d9-ec89-469d-91ff-f9c7caf75b3a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:27.771572 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ce1094d9-ec89-469d-91ff-f9c7caf75b3a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:27.772005 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ce1094d9-ec89-469d-91ff-f9c7caf75b3a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:27.801143 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ce1094d9-ec89-469d-91ff-f9c7caf75b3a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-volume_attachments/ed97a5c4-f8f4-444a-9ddb-d9637e59f091" status: 200 len: 194 microversion: 2.1 time: 0.041619 May 23 16:55:27.801727 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 410/843] 10.222.0.74 () {58 vars in 1412 bytes} [Mon May 23 16:55:27 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-volume_attachments/ed97a5c4-f8f4-444a-9ddb-d9637e59f091 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:55:27.811358 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-9a002548-fc42-4feb-8ace-9fc2d43eb66e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:27.811900 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-9a002548-fc42-4feb-8ace-9fc2d43eb66e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:27.818498 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9a002548-fc42-4feb-8ace-9fc2d43eb66e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:27.818885 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9a002548-fc42-4feb-8ace-9fc2d43eb66e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:27.819647 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9a002548-fc42-4feb-8ace-9fc2d43eb66e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:27.820092 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9a002548-fc42-4feb-8ace-9fc2d43eb66e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:27.905655 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.objects.instance [None req-9a002548-fc42-4feb-8ace-9fc2d43eb66e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lazy-loading 'services' on Instance uuid de945e1d-3af8-44a5-a5e4-ece874d859d7 {{(pid=124715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:55:28.135151 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-9a002548-fc42-4feb-8ace-9fc2d43eb66e tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "DELETE /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-volume_attachments/ed97a5c4-f8f4-444a-9ddb-d9637e59f091" status: 202 len: 0 microversion: 2.1 time: 0.326692 May 23 16:55:28.138066 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 434/844] 10.222.0.74 () {58 vars in 1415 bytes} [Mon May 23 16:55:27 2022] DELETE /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-volume_attachments/ed97a5c4-f8f4-444a-9ddb-d9637e59f091 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:55:28.716489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-e41e5d14-46aa-4b6e-b24f-4e140b2fbf50 req-c65b0917-d9f8-4e42-9a7f-4614b413d3fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e461f9e-4217-45ec-bf28-2a70f7ca0f82", "tag": "9c208ee4-0165-4731-ad35-9eb054957a82"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:55:28.724532 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-e41e5d14-46aa-4b6e-b24f-4e140b2fbf50 req-c65b0917-d9f8-4e42-9a7f-4614b413d3fb service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:28.724984 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-e41e5d14-46aa-4b6e-b24f-4e140b2fbf50 req-c65b0917-d9f8-4e42-9a7f-4614b413d3fb service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:28.736884 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-e41e5d14-46aa-4b6e-b24f-4e140b2fbf50 req-c65b0917-d9f8-4e42-9a7f-4614b413d3fb service nova] Creating event network-changed:9c208ee4-0165-4731-ad35-9eb054957a82 for instance 5e461f9e-4217-45ec-bf28-2a70f7ca0f82 on hv-cinder-83925 May 23 16:55:28.741789 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-e41e5d14-46aa-4b6e-b24f-4e140b2fbf50 req-c65b0917-d9f8-4e42-9a7f-4614b413d3fb service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029197 May 23 16:55:28.742600 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 411/845] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:55:29.317777 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-5acfec3a-ec02-4ec2-bebe-56a18f5c0460 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:29.318944 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-5acfec3a-ec02-4ec2-bebe-56a18f5c0460 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:29.327527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5acfec3a-ec02-4ec2-bebe-56a18f5c0460 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:29.327989 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5acfec3a-ec02-4ec2-bebe-56a18f5c0460 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:29.328828 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5acfec3a-ec02-4ec2-bebe-56a18f5c0460 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:29.329272 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-5acfec3a-ec02-4ec2-bebe-56a18f5c0460 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:29.363011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-5acfec3a-ec02-4ec2-bebe-56a18f5c0460 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050555 May 23 16:55:29.363608 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 435/846] 10.222.0.74 () {58 vars in 1301 bytes} [Mon May 23 16:55:29 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 16:55:29.475222 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-76ae18ce-55fd-40b6-8443-c6f68ecf9597 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:29.476243 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-76ae18ce-55fd-40b6-8443-c6f68ecf9597 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:29.483283 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-76ae18ce-55fd-40b6-8443-c6f68ecf9597 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:29.483735 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-76ae18ce-55fd-40b6-8443-c6f68ecf9597 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:29.484554 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-76ae18ce-55fd-40b6-8443-c6f68ecf9597 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:29.484996 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-76ae18ce-55fd-40b6-8443-c6f68ecf9597 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:29.514571 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-76ae18ce-55fd-40b6-8443-c6f68ecf9597 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044123 May 23 16:55:29.515321 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 412/847] 10.222.0.74 () {58 vars in 1301 bytes} [Mon May 23 16:55:29 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 16:55:29.574188 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-2012650c-c2bd-4d27-9661-a4e8edecd96d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:29.574720 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-2012650c-c2bd-4d27-9661-a4e8edecd96d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:29.580946 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2012650c-c2bd-4d27-9661-a4e8edecd96d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:29.581394 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2012650c-c2bd-4d27-9661-a4e8edecd96d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:29.582170 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2012650c-c2bd-4d27-9661-a4e8edecd96d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:29.582604 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2012650c-c2bd-4d27-9661-a4e8edecd96d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:29.613847 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-2012650c-c2bd-4d27-9661-a4e8edecd96d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Going to try to terminate instance {{(pid=124715) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 16:55:29.927112 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-2012650c-c2bd-4d27-9661-a4e8edecd96d tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "DELETE /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7" status: 204 len: 0 microversion: 2.1 time: 0.356455 May 23 16:55:29.927710 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 436/848] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 16:55:29 2022] DELETE /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 16:55:29.936370 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-66001f5d-729b-4b5c-b9bc-7eec44782960 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:29.937109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-66001f5d-729b-4b5c-b9bc-7eec44782960 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:29.943280 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-66001f5d-729b-4b5c-b9bc-7eec44782960 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:29.943741 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-66001f5d-729b-4b5c-b9bc-7eec44782960 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:29.944555 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-66001f5d-729b-4b5c-b9bc-7eec44782960 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:29.944998 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-66001f5d-729b-4b5c-b9bc-7eec44782960 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:30.074012 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-66001f5d-729b-4b5c-b9bc-7eec44782960 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:30.082159 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-66001f5d-729b-4b5c-b9bc-7eec44782960 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7" status: 200 len: 1671 microversion: 2.1 time: 0.150115 May 23 16:55:30.084557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 413/849] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:29 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:31.101225 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-763ac30d-8038-44f3-b938-50cb0ed82ae6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:31.101941 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-763ac30d-8038-44f3-b938-50cb0ed82ae6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:31.109850 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-763ac30d-8038-44f3-b938-50cb0ed82ae6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:31.110305 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-763ac30d-8038-44f3-b938-50cb0ed82ae6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:31.111077 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-763ac30d-8038-44f3-b938-50cb0ed82ae6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:31.111521 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-763ac30d-8038-44f3-b938-50cb0ed82ae6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:31.293326 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-763ac30d-8038-44f3-b938-50cb0ed82ae6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:31.301836 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-763ac30d-8038-44f3-b938-50cb0ed82ae6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7" status: 200 len: 1671 microversion: 2.1 time: 0.204941 May 23 16:55:31.302416 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 437/850] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:31 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 => generated 1671 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:32.319126 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-6576a83d-c49d-4a78-ade5-77df357c7d75 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:32.319746 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-6576a83d-c49d-4a78-ade5-77df357c7d75 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:32.327412 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6576a83d-c49d-4a78-ade5-77df357c7d75 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:32.327869 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6576a83d-c49d-4a78-ade5-77df357c7d75 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:32.328682 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6576a83d-c49d-4a78-ade5-77df357c7d75 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:32.329126 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6576a83d-c49d-4a78-ade5-77df357c7d75 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:32.513744 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-6576a83d-c49d-4a78-ade5-77df357c7d75 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:32.521795 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-6576a83d-c49d-4a78-ade5-77df357c7d75 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7" status: 200 len: 1671 microversion: 2.1 time: 0.206480 May 23 16:55:32.522394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 414/851] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:32 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 => generated 1671 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:33.400391 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-68d94cf0-df92-4afe-bcef-c13cf5589b4b req-77d1fca3-ca9c-4b29-a033-329f5e5addcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de945e1d-3af8-44a5-a5e4-ece874d859d7", "name": "network-vif-deleted", "tag": "56878ced-f382-4cec-8bad-fd66fd2ab2e9"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:55:33.409128 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-68d94cf0-df92-4afe-bcef-c13cf5589b4b req-77d1fca3-ca9c-4b29-a033-329f5e5addcc service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:33.409577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-68d94cf0-df92-4afe-bcef-c13cf5589b4b req-77d1fca3-ca9c-4b29-a033-329f5e5addcc service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:33.421631 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-68d94cf0-df92-4afe-bcef-c13cf5589b4b req-77d1fca3-ca9c-4b29-a033-329f5e5addcc service nova] Creating event network-vif-deleted:56878ced-f382-4cec-8bad-fd66fd2ab2e9 for instance de945e1d-3af8-44a5-a5e4-ece874d859d7 on hv-cinder-83925 May 23 16:55:33.426558 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-68d94cf0-df92-4afe-bcef-c13cf5589b4b req-77d1fca3-ca9c-4b29-a033-329f5e5addcc service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029814 May 23 16:55:33.427146 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 438/852] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:55:33.541470 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-0d0abd7b-a270-435a-b5dc-04281b4cd758 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:33.544488 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-0d0abd7b-a270-435a-b5dc-04281b4cd758 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:33.551754 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0d0abd7b-a270-435a-b5dc-04281b4cd758 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:33.552209 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0d0abd7b-a270-435a-b5dc-04281b4cd758 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:33.553277 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0d0abd7b-a270-435a-b5dc-04281b4cd758 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:33.553724 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0d0abd7b-a270-435a-b5dc-04281b4cd758 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:33.625010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-0d0abd7b-a270-435a-b5dc-04281b4cd758 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e90497b6d9c4a789f6b31680e069087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14a96662507495b84670e2f62f90f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:33.632808 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-0d0abd7b-a270-435a-b5dc-04281b4cd758 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7" status: 200 len: 1322 microversion: 2.1 time: 0.096724 May 23 16:55:33.633593 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 415/853] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:33 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 => generated 1322 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:34.651080 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a281f9b2-262e-4bd2-a422-e0ff6aca28cf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:34.651789 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a281f9b2-262e-4bd2-a422-e0ff6aca28cf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:34.658413 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a281f9b2-262e-4bd2-a422-e0ff6aca28cf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:34.658879 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a281f9b2-262e-4bd2-a422-e0ff6aca28cf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:34.659656 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a281f9b2-262e-4bd2-a422-e0ff6aca28cf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:34.660101 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a281f9b2-262e-4bd2-a422-e0ff6aca28cf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:34.674067 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-a281f9b2-262e-4bd2-a422-e0ff6aca28cf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] HTTP exception thrown: Instance de945e1d-3af8-44a5-a5e4-ece874d859d7 could not be found. May 23 16:55:34.675675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a281f9b2-262e-4bd2-a422-e0ff6aca28cf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Request method failure captured: May 23 16:55:34.675675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 HTTP/1.1 May 23 16:55:34.675675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:55:34.675675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:55:34.675675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:55:34.675675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:55:34.675675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:55:34.675675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:55:34.675675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:55:34.675675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:55:34.675675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7o8fTftQq8dNo83YLVJfdcwwAyPyxNSHwUl-IlxFZzI8lYpiwVJZJKo48CDOUE1Kv96p-xOEXfTHc9h05OOoAJd00McLos4eBlCi78kboMkVYqk_iAatcbtlsB28uBEmgi54fTXGOvRc_WTpKSZYYEjTn0wQq1atKL4y4n0nu2Ec0U May 23 16:55:34.675675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:55:34.675675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:55:34.675675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:55:34.675675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:55:34.675675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:55:34.675675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:55:34.675675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: c14a96662507495b84670e2f62f90f59 May 23 16:55:34.675675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-AttachVolumeTestJSON-566752418 May 23 16:55:34.675675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:55:34.675675 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:55:34.677481 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c14a96662507495b84670e2f62f90f59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c14a96662507495b84670e2f62f90f59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c14a96662507495b84670e2f62f90f59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c14a96662507495b84670e2f62f90f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:55:34.677481 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-AttachVolumeTestJSON-566752418 May 23 16:55:34.677481 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: c14a96662507495b84670e2f62f90f59 May 23 16:55:34.677481 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-AttachVolumeTestJSON-566752418 May 23 16:55:34.677481 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-AttachVolumeTestJSON-566752418-project May 23 16:55:34.677481 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:55:34.677481 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:55:34.677481 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: 0e90497b6d9c4a789f6b31680e069087 May 23 16:55:34.677481 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-AttachVolumeTestJSON-566752418-project May 23 16:55:34.677481 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 16:55:34.677481 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Instance de945e1d-3af8-44a5-a5e4-ece874d859d7 could not be found. May 23 16:55:34.677481 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': 'de945e1d-3af8-44a5-a5e4-ece874d859d7'} May 23 16:55:34.678336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:55:34.678336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:55:34.678336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:55:34.678336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:55:34.678336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:55:34.678336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:55:34.678336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:55:34.678336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:55:34.678336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:55:34.678336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:55:34.678336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de945e1d-3af8-44a5-a5e4-ece874d859d7 could not be found. May 23 16:55:34.678336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:55:34.678336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:55:34.678336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:55:34.678336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:55:34.678336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:55:34.678336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:55:34.678336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:55:34.678336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:55:34.678336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:55:34.679837 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:55:34.679837 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:55:34.679837 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:55:34.679837 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:55:34.679837 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:55:34.679837 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:55:34.679837 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:55:34.679837 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de945e1d-3af8-44a5-a5e4-ece874d859d7 could not be found. May 23 16:55:34.679837 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:55:34.679837 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:55:34.679837 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:55:34.679837 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:55:34.679837 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:55:34.679837 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:55:34.679837 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:55:34.679837 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:55:34.679837 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de945e1d-3af8-44a5-a5e4-ece874d859d7 could not be found. May 23 16:55:34.679837 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:55:34.681206 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a281f9b2-262e-4bd2-a422-e0ff6aca28cf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Returning 404 to user: Instance de945e1d-3af8-44a5-a5e4-ece874d859d7 could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:55:34.681206 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a281f9b2-262e-4bd2-a422-e0ff6aca28cf tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7" status: 404 len: 111 microversion: 2.1 time: 0.030907 May 23 16:55:34.681206 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 439/854] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:34 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:55:34.686795 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-113d3efa-1a87-4ced-81bf-4a4b91559d17 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '.version_select at 0x7f224c64cf70>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:34.693305 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=53 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:34.752443 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-113d3efa-1a87-4ced-81bf-4a4b91559d17 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110587716" status: 202 len: 0 microversion: 2.1 time: 0.070086 May 23 16:55:34.753038 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 416/855] 10.222.0.74 () {58 vars in 1220 bytes} [Mon May 23 16:55:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110587716 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:55:38.283515 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-877178d8-51a6-42df-bcaa-fc57e41dd3f9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:38.284008 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-877178d8-51a6-42df-bcaa-fc57e41dd3f9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:38.290722 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-877178d8-51a6-42df-bcaa-fc57e41dd3f9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:38.292590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-877178d8-51a6-42df-bcaa-fc57e41dd3f9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:38.292590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-877178d8-51a6-42df-bcaa-fc57e41dd3f9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:38.292590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-877178d8-51a6-42df-bcaa-fc57e41dd3f9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:38.305944 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-877178d8-51a6-42df-bcaa-fc57e41dd3f9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] HTTP exception thrown: Instance de945e1d-3af8-44a5-a5e4-ece874d859d7 could not be found. May 23 16:55:38.307639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-877178d8-51a6-42df-bcaa-fc57e41dd3f9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Request method failure captured: May 23 16:55:38.307639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: DELETE /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 HTTP/1.1 May 23 16:55:38.307639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:55:38.307639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:55:38.307639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:55:38.307639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:55:38.307639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:55:38.307639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:55:38.307639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:55:38.307639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:55:38.307639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7o8fTftQq8dNo83YLVJfdcwwAyPyxNSHwUl-IlxFZzI8lYpiwVJZJKo48CDOUE1Kv96p-xOEXfTHc9h05OOoAJd00McLos4eBlCi78kboMkVYqk_iAatcbtlsB28uBEmgi54fTXGOvRc_WTpKSZYYEjTn0wQq1atKL4y4n0nu2Ec0U May 23 16:55:38.307639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:55:38.307639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:55:38.307639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:55:38.307639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:55:38.307639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:55:38.307639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:55:38.307639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: c14a96662507495b84670e2f62f90f59 May 23 16:55:38.307639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-AttachVolumeTestJSON-566752418 May 23 16:55:38.307639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:55:38.307639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:55:38.309402 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c14a96662507495b84670e2f62f90f59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c14a96662507495b84670e2f62f90f59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c14a96662507495b84670e2f62f90f59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c14a96662507495b84670e2f62f90f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:55:38.309402 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-AttachVolumeTestJSON-566752418 May 23 16:55:38.309402 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: c14a96662507495b84670e2f62f90f59 May 23 16:55:38.309402 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-AttachVolumeTestJSON-566752418 May 23 16:55:38.309402 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-AttachVolumeTestJSON-566752418-project May 23 16:55:38.309402 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:55:38.309402 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:55:38.309402 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: 0e90497b6d9c4a789f6b31680e069087 May 23 16:55:38.309402 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-AttachVolumeTestJSON-566752418-project May 23 16:55:38.309402 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 16:55:38.309402 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Instance de945e1d-3af8-44a5-a5e4-ece874d859d7 could not be found. May 23 16:55:38.309402 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': 'de945e1d-3af8-44a5-a5e4-ece874d859d7'} May 23 16:55:38.310577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:55:38.310577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:55:38.310577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:55:38.310577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:55:38.310577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:55:38.310577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:55:38.310577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:55:38.310577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:55:38.310577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:55:38.310577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:55:38.310577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de945e1d-3af8-44a5-a5e4-ece874d859d7 could not be found. May 23 16:55:38.310577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:55:38.310577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:55:38.310577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:55:38.310577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:55:38.310577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:55:38.310577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:55:38.310577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:55:38.310577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:55:38.310577 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:55:38.312769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:55:38.312769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 16:55:38.312769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 16:55:38.312769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 16:55:38.312769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 16:55:38.312769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:55:38.312769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:55:38.312769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:55:38.312769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:55:38.312769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de945e1d-3af8-44a5-a5e4-ece874d859d7 could not be found. May 23 16:55:38.312769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:55:38.312769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:55:38.312769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:55:38.312769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:55:38.312769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:55:38.312769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:55:38.312769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:55:38.312769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:55:38.312769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de945e1d-3af8-44a5-a5e4-ece874d859d7 could not be found. May 23 16:55:38.312769 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:55:38.314485 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-877178d8-51a6-42df-bcaa-fc57e41dd3f9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Returning 404 to user: Instance de945e1d-3af8-44a5-a5e4-ece874d859d7 could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:55:38.314485 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-877178d8-51a6-42df-bcaa-fc57e41dd3f9 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "DELETE /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7" status: 404 len: 111 microversion: 2.1 time: 0.030351 May 23 16:55:38.314485 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 440/856] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 16:55:38 2022] DELETE /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:55:38.318379 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-c520078f-1198-471c-9ef5-ad6ebf7cf73a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:38.322766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-c520078f-1198-471c-9ef5-ad6ebf7cf73a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: de945e1d-3af8-44a5-a5e4-ece874d859d7] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:38.326170 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c520078f-1198-471c-9ef5-ad6ebf7cf73a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:38.326626 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c520078f-1198-471c-9ef5-ad6ebf7cf73a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:38.328180 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c520078f-1198-471c-9ef5-ad6ebf7cf73a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:38.328664 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c520078f-1198-471c-9ef5-ad6ebf7cf73a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:38.342171 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-c520078f-1198-471c-9ef5-ad6ebf7cf73a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] HTTP exception thrown: Instance de945e1d-3af8-44a5-a5e4-ece874d859d7 could not be found. May 23 16:55:38.343815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-c520078f-1198-471c-9ef5-ad6ebf7cf73a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Request method failure captured: May 23 16:55:38.343815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 HTTP/1.1 May 23 16:55:38.343815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:55:38.343815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:55:38.343815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:55:38.343815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 16:55:38.343815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:55:38.343815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:55:38.343815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:55:38.343815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:55:38.343815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7o8fTftQq8dNo83YLVJfdcwwAyPyxNSHwUl-IlxFZzI8lYpiwVJZJKo48CDOUE1Kv96p-xOEXfTHc9h05OOoAJd00McLos4eBlCi78kboMkVYqk_iAatcbtlsB28uBEmgi54fTXGOvRc_WTpKSZYYEjTn0wQq1atKL4y4n0nu2Ec0U May 23 16:55:38.343815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:55:38.343815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:55:38.343815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:55:38.343815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:55:38.343815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:55:38.343815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:55:38.343815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: c14a96662507495b84670e2f62f90f59 May 23 16:55:38.343815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-AttachVolumeTestJSON-566752418 May 23 16:55:38.343815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:55:38.343815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:55:38.345386 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c14a96662507495b84670e2f62f90f59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c14a96662507495b84670e2f62f90f59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c14a96662507495b84670e2f62f90f59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c14a96662507495b84670e2f62f90f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:55:38.345386 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-AttachVolumeTestJSON-566752418 May 23 16:55:38.345386 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: c14a96662507495b84670e2f62f90f59 May 23 16:55:38.345386 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-AttachVolumeTestJSON-566752418 May 23 16:55:38.345386 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-AttachVolumeTestJSON-566752418-project May 23 16:55:38.345386 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:55:38.345386 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:55:38.345386 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 0e90497b6d9c4a789f6b31680e069087 May 23 16:55:38.345386 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-AttachVolumeTestJSON-566752418-project May 23 16:55:38.345386 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: > May 23 16:55:38.345386 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Instance de945e1d-3af8-44a5-a5e4-ece874d859d7 could not be found. May 23 16:55:38.345386 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': 'de945e1d-3af8-44a5-a5e4-ece874d859d7'} May 23 16:55:38.346268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:55:38.346268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:55:38.346268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:55:38.346268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:55:38.346268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:55:38.346268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:55:38.346268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:55:38.346268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:55:38.346268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:55:38.346268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:55:38.346268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de945e1d-3af8-44a5-a5e4-ece874d859d7 could not be found. May 23 16:55:38.346268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:55:38.346268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:55:38.346268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:55:38.346268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:55:38.346268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:55:38.346268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:55:38.346268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:55:38.346268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:55:38.346268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:55:38.347527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:55:38.347527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:55:38.347527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:55:38.347527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:55:38.347527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:55:38.347527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:55:38.347527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:55:38.347527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de945e1d-3af8-44a5-a5e4-ece874d859d7 could not be found. May 23 16:55:38.347527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:55:38.347527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:55:38.347527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:55:38.347527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:55:38.347527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:55:38.347527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:55:38.347527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:55:38.347527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:55:38.347527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de945e1d-3af8-44a5-a5e4-ece874d859d7 could not be found. May 23 16:55:38.347527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:55:38.348638 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-c520078f-1198-471c-9ef5-ad6ebf7cf73a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Returning 404 to user: Instance de945e1d-3af8-44a5-a5e4-ece874d859d7 could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:55:38.348638 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-c520078f-1198-471c-9ef5-ad6ebf7cf73a tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7" status: 404 len: 111 microversion: 2.1 time: 0.030890 May 23 16:55:38.348638 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 417/857] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:38 2022] GET /compute/v2.1/servers/de945e1d-3af8-44a5-a5e4-ece874d859d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:55:39.579521 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c6e6adfa-5a13-40c2-8934-3478aa504da6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:39.580035 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-c6e6adfa-5a13-40c2-8934-3478aa504da6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:39.586285 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c6e6adfa-5a13-40c2-8934-3478aa504da6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:39.586738 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c6e6adfa-5a13-40c2-8934-3478aa504da6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:39.587510 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c6e6adfa-5a13-40c2-8934-3478aa504da6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:39.587953 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c6e6adfa-5a13-40c2-8934-3478aa504da6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:39.602211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-c6e6adfa-5a13-40c2-8934-3478aa504da6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] HTTP exception thrown: Instance 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 could not be found. May 23 16:55:39.604205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c6e6adfa-5a13-40c2-8934-3478aa504da6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Request method failure captured: May 23 16:55:39.604205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: DELETE /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 HTTP/1.1 May 23 16:55:39.604205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:55:39.604205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:55:39.604205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:55:39.604205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:55:39.604205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:55:39.604205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:55:39.604205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:55:39.604205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:55:39.604205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7o8fTftQq8dNo83YLVJfdcwwAyPyxNSHwUl-IlxFZzI8lYpiwVJZJKo48CDOUE1Kv96p-xOEXfTHc9h05OOoAJd00McLos4eBlCi78kboMkVYqk_iAatcbtlsB28uBEmgi54fTXGOvRc_WTpKSZYYEjTn0wQq1atKL4y4n0nu2Ec0U May 23 16:55:39.604205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:55:39.604205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:55:39.604205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:55:39.604205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:55:39.604205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:55:39.604205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:55:39.604205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: c14a96662507495b84670e2f62f90f59 May 23 16:55:39.604205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-AttachVolumeTestJSON-566752418 May 23 16:55:39.604205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:55:39.604205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:55:39.605935 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c14a96662507495b84670e2f62f90f59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c14a96662507495b84670e2f62f90f59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c14a96662507495b84670e2f62f90f59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c14a96662507495b84670e2f62f90f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:55:39.605935 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-AttachVolumeTestJSON-566752418 May 23 16:55:39.605935 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: c14a96662507495b84670e2f62f90f59 May 23 16:55:39.605935 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-AttachVolumeTestJSON-566752418 May 23 16:55:39.605935 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-AttachVolumeTestJSON-566752418-project May 23 16:55:39.605935 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:55:39.605935 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:55:39.605935 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: 0e90497b6d9c4a789f6b31680e069087 May 23 16:55:39.605935 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-AttachVolumeTestJSON-566752418-project May 23 16:55:39.605935 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 16:55:39.605935 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Instance 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 could not be found. May 23 16:55:39.605935 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': '405bb8d2-37bb-47fc-9ea9-c432cc0bafd4'} May 23 16:55:39.606916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:55:39.606916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:55:39.606916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:55:39.606916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:55:39.606916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:55:39.606916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:55:39.606916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:55:39.606916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:55:39.606916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:55:39.606916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:55:39.606916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 could not be found. May 23 16:55:39.606916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:55:39.606916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:55:39.606916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:55:39.606916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:55:39.606916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:55:39.606916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:55:39.606916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:55:39.606916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:55:39.606916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:55:39.608527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:55:39.608527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 16:55:39.608527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 16:55:39.608527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 16:55:39.608527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 16:55:39.608527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:55:39.608527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:55:39.608527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:55:39.608527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:55:39.608527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 could not be found. May 23 16:55:39.608527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:55:39.608527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:55:39.608527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:55:39.608527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:55:39.608527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:55:39.608527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:55:39.608527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:55:39.608527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:55:39.608527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 could not be found. May 23 16:55:39.608527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:55:39.610134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c6e6adfa-5a13-40c2-8934-3478aa504da6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Returning 404 to user: Instance 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:55:39.610134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-c6e6adfa-5a13-40c2-8934-3478aa504da6 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "DELETE /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 404 len: 111 microversion: 2.1 time: 0.030489 May 23 16:55:39.610134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 441/858] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 16:55:39 2022] DELETE /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:55:39.614017 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-f25cf2d3-46ad-46aa-bce1-9b359aace049 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:39.614641 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-f25cf2d3-46ad-46aa-bce1-9b359aace049 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] [instance: 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:39.621268 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f25cf2d3-46ad-46aa-bce1-9b359aace049 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:39.621728 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f25cf2d3-46ad-46aa-bce1-9b359aace049 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:39.622543 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f25cf2d3-46ad-46aa-bce1-9b359aace049 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:39.622989 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f25cf2d3-46ad-46aa-bce1-9b359aace049 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:39.636969 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-f25cf2d3-46ad-46aa-bce1-9b359aace049 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] HTTP exception thrown: Instance 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 could not be found. May 23 16:55:39.638525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-f25cf2d3-46ad-46aa-bce1-9b359aace049 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Request method failure captured: May 23 16:55:39.638525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 HTTP/1.1 May 23 16:55:39.638525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:55:39.638525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:55:39.638525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:55:39.638525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 16:55:39.638525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:55:39.638525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:55:39.638525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:55:39.638525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:55:39.638525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7o8fTftQq8dNo83YLVJfdcwwAyPyxNSHwUl-IlxFZzI8lYpiwVJZJKo48CDOUE1Kv96p-xOEXfTHc9h05OOoAJd00McLos4eBlCi78kboMkVYqk_iAatcbtlsB28uBEmgi54fTXGOvRc_WTpKSZYYEjTn0wQq1atKL4y4n0nu2Ec0U May 23 16:55:39.638525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:55:39.638525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:55:39.638525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:55:39.638525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:55:39.638525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:55:39.638525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:55:39.638525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: c14a96662507495b84670e2f62f90f59 May 23 16:55:39.638525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-AttachVolumeTestJSON-566752418 May 23 16:55:39.638525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:55:39.638525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:55:39.640638 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c14a96662507495b84670e2f62f90f59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c14a96662507495b84670e2f62f90f59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c14a96662507495b84670e2f62f90f59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c14a96662507495b84670e2f62f90f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:55:39.640638 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-AttachVolumeTestJSON-566752418 May 23 16:55:39.640638 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: c14a96662507495b84670e2f62f90f59 May 23 16:55:39.640638 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-AttachVolumeTestJSON-566752418 May 23 16:55:39.640638 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-AttachVolumeTestJSON-566752418-project May 23 16:55:39.640638 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:55:39.640638 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:55:39.640638 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 0e90497b6d9c4a789f6b31680e069087 May 23 16:55:39.640638 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-AttachVolumeTestJSON-566752418-project May 23 16:55:39.640638 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: > May 23 16:55:39.640638 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Instance 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 could not be found. May 23 16:55:39.640638 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': '405bb8d2-37bb-47fc-9ea9-c432cc0bafd4'} May 23 16:55:39.641534 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:55:39.641534 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:55:39.641534 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:55:39.641534 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:55:39.641534 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:55:39.641534 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:55:39.641534 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:55:39.641534 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:55:39.641534 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:55:39.641534 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:55:39.641534 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 could not be found. May 23 16:55:39.641534 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:55:39.641534 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:55:39.641534 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:55:39.641534 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:55:39.641534 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:55:39.641534 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:55:39.641534 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:55:39.641534 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:55:39.641534 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:55:39.643031 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:55:39.643031 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:55:39.643031 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:55:39.643031 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:55:39.643031 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:55:39.643031 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:55:39.643031 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:55:39.643031 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 could not be found. May 23 16:55:39.643031 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:55:39.643031 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:55:39.643031 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:55:39.643031 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:55:39.643031 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:55:39.643031 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:55:39.643031 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:55:39.643031 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:55:39.643031 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 could not be found. May 23 16:55:39.643031 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:55:39.644906 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-f25cf2d3-46ad-46aa-bce1-9b359aace049 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] Returning 404 to user: Instance 405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:55:39.644906 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-f25cf2d3-46ad-46aa-bce1-9b359aace049 tempest-AttachVolumeTestJSON-566752418 tempest-AttachVolumeTestJSON-566752418-project] 10.222.0.74 "GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4" status: 404 len: 111 microversion: 2.1 time: 0.029900 May 23 16:55:39.644906 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 418/859] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:39 2022] GET /compute/v2.1/servers/405bb8d2-37bb-47fc-9ea9-c432cc0bafd4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:55:41.552933 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-3085769c-b562-40c6-b982-55c639b1b78d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:41.553439 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-3085769c-b562-40c6-b982-55c639b1b78d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:41.560189 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3085769c-b562-40c6-b982-55c639b1b78d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:41.560679 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3085769c-b562-40c6-b982-55c639b1b78d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:41.561993 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3085769c-b562-40c6-b982-55c639b1b78d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:41.562447 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3085769c-b562-40c6-b982-55c639b1b78d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:41.587060 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-3085769c-b562-40c6-b982-55c639b1b78d tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f/ips" status: 200 len: 151 microversion: 2.1 time: 0.037930 May 23 16:55:41.587639 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 442/860] 10.222.0.74 () {58 vars in 1247 bytes} [Mon May 23 16:55:41 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:55:43.203751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-657b5749-9d8f-417a-b3a6-c826a1d207c7 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d6adf9b-a275-452b-af55-5fd29eea8c6a"}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:55:43.204864 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-657b5749-9d8f-417a-b3a6-c826a1d207c7 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:43.211821 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-657b5749-9d8f-417a-b3a6-c826a1d207c7 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:43.212265 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-657b5749-9d8f-417a-b3a6-c826a1d207c7 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:43.213140 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-657b5749-9d8f-417a-b3a6-c826a1d207c7 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:43.213586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-657b5749-9d8f-417a-b3a6-c826a1d207c7 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:43.804146 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:43.914667 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-657b5749-9d8f-417a-b3a6-c826a1d207c7 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "POST /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.715715 May 23 16:55:43.915280 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 419/861] 10.222.0.74 () {60 vars in 1322 bytes} [Mon May 23 16:55:43 2022] POST /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f/os-volume_attachments => generated 194 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:55:51.511233 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-81fef0ba-1f94-44ef-8eb8-db16cb1581ca tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:51.511761 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-81fef0ba-1f94-44ef-8eb8-db16cb1581ca tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:51.514321 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:51.520050 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-81fef0ba-1f94-44ef-8eb8-db16cb1581ca tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:51.520540 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-81fef0ba-1f94-44ef-8eb8-db16cb1581ca tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:51.521315 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-81fef0ba-1f94-44ef-8eb8-db16cb1581ca tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:51.521762 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-81fef0ba-1f94-44ef-8eb8-db16cb1581ca tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:51.604642 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.objects.instance [None req-81fef0ba-1f94-44ef-8eb8-db16cb1581ca tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lazy-loading 'services' on Instance uuid f4b22328-963e-4a51-8ace-087e5b74cb2f {{(pid=124715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:55:51.779301 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-81fef0ba-1f94-44ef-8eb8-db16cb1581ca tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "DELETE /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f/os-volume_attachments/6d6adf9b-a275-452b-af55-5fd29eea8c6a" status: 202 len: 0 microversion: 2.1 time: 0.271776 May 23 16:55:51.780048 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 443/862] 10.222.0.74 () {58 vars in 1415 bytes} [Mon May 23 16:55:51 2022] DELETE /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f/os-volume_attachments/6d6adf9b-a275-452b-af55-5fd29eea8c6a => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:55:51.790995 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-1f7b0214-de52-4d7c-a16c-9756625f3596 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:51.792117 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-1f7b0214-de52-4d7c-a16c-9756625f3596 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:51.800483 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1f7b0214-de52-4d7c-a16c-9756625f3596 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:51.800941 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1f7b0214-de52-4d7c-a16c-9756625f3596 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:51.801731 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1f7b0214-de52-4d7c-a16c-9756625f3596 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:51.802176 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1f7b0214-de52-4d7c-a16c-9756625f3596 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:51.832016 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-1f7b0214-de52-4d7c-a16c-9756625f3596 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046453 May 23 16:55:51.832535 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 420/863] 10.222.0.74 () {58 vars in 1301 bytes} [Mon May 23 16:55:51 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:55:52.844525 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-beea9206-940b-4299-b7db-9a314b3589fa tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:52.845724 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-beea9206-940b-4299-b7db-9a314b3589fa tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:52.852697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-beea9206-940b-4299-b7db-9a314b3589fa tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:52.853143 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-beea9206-940b-4299-b7db-9a314b3589fa tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:52.853908 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-beea9206-940b-4299-b7db-9a314b3589fa tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:52.854342 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-beea9206-940b-4299-b7db-9a314b3589fa tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:52.883926 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-beea9206-940b-4299-b7db-9a314b3589fa tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044699 May 23 16:55:52.884499 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 444/864] 10.222.0.74 () {58 vars in 1301 bytes} [Mon May 23 16:55:52 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:55:53.896067 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-78de0d61-e0be-4441-9a40-df29a71e3284 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:53.897012 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-78de0d61-e0be-4441-9a40-df29a71e3284 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:53.904166 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-78de0d61-e0be-4441-9a40-df29a71e3284 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:53.904635 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-78de0d61-e0be-4441-9a40-df29a71e3284 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:53.905397 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-78de0d61-e0be-4441-9a40-df29a71e3284 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:53.906000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-78de0d61-e0be-4441-9a40-df29a71e3284 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:53.933978 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-78de0d61-e0be-4441-9a40-df29a71e3284 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042833 May 23 16:55:53.934543 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 421/865] 10.222.0.74 () {58 vars in 1301 bytes} [Mon May 23 16:55:53 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 16:55:53.994006 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-377ed005-d377-4729-8da7-4545f1958a64 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:53.994562 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-377ed005-d377-4729-8da7-4545f1958a64 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:54.001245 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-377ed005-d377-4729-8da7-4545f1958a64 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:54.001699 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-377ed005-d377-4729-8da7-4545f1958a64 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:54.003150 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-377ed005-d377-4729-8da7-4545f1958a64 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:54.003607 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-377ed005-d377-4729-8da7-4545f1958a64 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:54.029835 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-377ed005-d377-4729-8da7-4545f1958a64 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Going to try to terminate instance {{(pid=124715) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 16:55:54.264997 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-377ed005-d377-4729-8da7-4545f1958a64 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "DELETE /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 204 len: 0 microversion: 2.1 time: 0.274566 May 23 16:55:54.265584 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 445/866] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 16:55:53 2022] DELETE /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 16:55:54.274831 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-7226cf07-202b-44f6-9aff-7f9de5c43932 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:54.275455 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-7226cf07-202b-44f6-9aff-7f9de5c43932 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:54.282553 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7226cf07-202b-44f6-9aff-7f9de5c43932 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:54.283042 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7226cf07-202b-44f6-9aff-7f9de5c43932 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:54.283953 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7226cf07-202b-44f6-9aff-7f9de5c43932 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:54.284805 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7226cf07-202b-44f6-9aff-7f9de5c43932 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:54.421312 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7226cf07-202b-44f6-9aff-7f9de5c43932 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:54.429515 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-7226cf07-202b-44f6-9aff-7f9de5c43932 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 200 len: 1683 microversion: 2.1 time: 0.159016 May 23 16:55:54.430090 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 422/867] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:54 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:55.447678 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-d8bcee0f-5c51-4eaa-8038-c8ba9e1753f3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:55.448346 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-d8bcee0f-5c51-4eaa-8038-c8ba9e1753f3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:55.454758 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d8bcee0f-5c51-4eaa-8038-c8ba9e1753f3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:55.455217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d8bcee0f-5c51-4eaa-8038-c8ba9e1753f3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:55.456873 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d8bcee0f-5c51-4eaa-8038-c8ba9e1753f3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:55.457312 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d8bcee0f-5c51-4eaa-8038-c8ba9e1753f3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:55.596602 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d8bcee0f-5c51-4eaa-8038-c8ba9e1753f3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:55.604377 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-d8bcee0f-5c51-4eaa-8038-c8ba9e1753f3 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 200 len: 1683 microversion: 2.1 time: 0.160993 May 23 16:55:55.605146 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 446/868] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:55 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:56.622171 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-904d0f2f-5046-43a8-b1b8-877020e6fb6b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:56.622879 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-904d0f2f-5046-43a8-b1b8-877020e6fb6b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:56.630265 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-904d0f2f-5046-43a8-b1b8-877020e6fb6b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:56.630725 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-904d0f2f-5046-43a8-b1b8-877020e6fb6b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:56.631503 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-904d0f2f-5046-43a8-b1b8-877020e6fb6b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:56.631952 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-904d0f2f-5046-43a8-b1b8-877020e6fb6b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:56.697350 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-904d0f2f-5046-43a8-b1b8-877020e6fb6b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:56.706807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-904d0f2f-5046-43a8-b1b8-877020e6fb6b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 200 len: 1615 microversion: 2.1 time: 0.088436 May 23 16:55:56.708820 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 423/869] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:56 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 1615 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:56.985980 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-87f56fea-8505-45cb-a34e-5ad1eb3cd084 req-725c836a-2fbb-429a-b88e-41003d94f3da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4b22328-963e-4a51-8ace-087e5b74cb2f", "name": "network-vif-deleted", "tag": "a163250d-cd50-475a-b6a2-fbdd4207e65f"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:55:56.995703 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-87f56fea-8505-45cb-a34e-5ad1eb3cd084 req-725c836a-2fbb-429a-b88e-41003d94f3da service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:56.998609 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-87f56fea-8505-45cb-a34e-5ad1eb3cd084 req-725c836a-2fbb-429a-b88e-41003d94f3da service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:57.001417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:55:57.010873 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-87f56fea-8505-45cb-a34e-5ad1eb3cd084 req-725c836a-2fbb-429a-b88e-41003d94f3da service nova] Creating event network-vif-deleted:a163250d-cd50-475a-b6a2-fbdd4207e65f for instance f4b22328-963e-4a51-8ace-087e5b74cb2f on hv-cinder-83925 May 23 16:55:57.016697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-87f56fea-8505-45cb-a34e-5ad1eb3cd084 req-725c836a-2fbb-429a-b88e-41003d94f3da service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034642 May 23 16:55:57.021401 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 447/870] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:55:57.731216 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-0f2ee41e-3e0f-4dec-83e3-5d75b08056d0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:57.731973 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-0f2ee41e-3e0f-4dec-83e3-5d75b08056d0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:57.739335 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0f2ee41e-3e0f-4dec-83e3-5d75b08056d0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:57.739789 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0f2ee41e-3e0f-4dec-83e3-5d75b08056d0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:57.740591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0f2ee41e-3e0f-4dec-83e3-5d75b08056d0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:57.741030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0f2ee41e-3e0f-4dec-83e3-5d75b08056d0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:57.781005 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0f2ee41e-3e0f-4dec-83e3-5d75b08056d0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:57.781464 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0f2ee41e-3e0f-4dec-83e3-5d75b08056d0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:57.781928 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.objects.instance [None req-0f2ee41e-3e0f-4dec-83e3-5d75b08056d0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lazy-loading 'fault' on Instance uuid f4b22328-963e-4a51-8ace-087e5b74cb2f {{(pid=124714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:55:57.823918 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-0f2ee41e-3e0f-4dec-83e3-5d75b08056d0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718a82d2f4294f68965ce01aac0fc166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e293f2b3de9143ad9e8a1fe8b67d6641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:55:57.832059 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-0f2ee41e-3e0f-4dec-83e3-5d75b08056d0 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 200 len: 1331 microversion: 2.1 time: 0.104767 May 23 16:55:57.832725 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 424/871] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:57 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:55:58.855425 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-60693e0b-317b-4f2f-96ee-af8ec8e6498b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:58.856126 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-60693e0b-317b-4f2f-96ee-af8ec8e6498b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:55:58.863550 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-60693e0b-317b-4f2f-96ee-af8ec8e6498b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:58.867586 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-60693e0b-317b-4f2f-96ee-af8ec8e6498b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:58.867586 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-60693e0b-317b-4f2f-96ee-af8ec8e6498b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:55:58.867586 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-60693e0b-317b-4f2f-96ee-af8ec8e6498b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:55:58.880627 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-60693e0b-317b-4f2f-96ee-af8ec8e6498b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] HTTP exception thrown: Instance f4b22328-963e-4a51-8ace-087e5b74cb2f could not be found. May 23 16:55:58.882932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-60693e0b-317b-4f2f-96ee-af8ec8e6498b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Request method failure captured: May 23 16:55:58.882932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f HTTP/1.1 May 23 16:55:58.882932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:55:58.882932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:55:58.882932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:55:58.882932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:55:58.882932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:55:58.882932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:55:58.882932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:55:58.882932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:55:58.882932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7oyo5VTSnwIFQPT0kTtFaHtIkHFj5L-FdhSIUmX9rttwLCW8jCAZ-X2qSMb7H2nHSgXjB6vWffoOpo-tnDcGctqzpOOjedHQxhH_K6_YUurOv1U6F0vB3iEbd4WjdXEZ7YlGpKqnMbRleSlAkItJeye3e1UHY4m4KuLnUpITA6zvao May 23 16:55:58.882932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:55:58.882932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:55:58.882932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:55:58.882932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:55:58.882932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:55:58.882932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:55:58.882932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:55:58.882932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:55:58.882932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:55:58.882932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:55:58.884682 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:55:58.884682 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:55:58.884682 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:55:58.884682 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:55:58.884682 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:55:58.884682 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:55:58.884682 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:55:58.884682 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: 718a82d2f4294f68965ce01aac0fc166 May 23 16:55:58.884682 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:55:58.884682 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 16:55:58.884682 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Instance f4b22328-963e-4a51-8ace-087e5b74cb2f could not be found. May 23 16:55:58.884682 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': 'f4b22328-963e-4a51-8ace-087e5b74cb2f'} May 23 16:55:58.885619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:55:58.885619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:55:58.885619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:55:58.885619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:55:58.885619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:55:58.885619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:55:58.885619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:55:58.885619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:55:58.885619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:55:58.885619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:55:58.885619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4b22328-963e-4a51-8ace-087e5b74cb2f could not be found. May 23 16:55:58.885619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:55:58.885619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:55:58.885619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:55:58.885619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:55:58.885619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:55:58.885619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:55:58.885619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:55:58.885619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:55:58.885619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:55:58.887177 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:55:58.887177 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:55:58.887177 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:55:58.887177 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:55:58.887177 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:55:58.887177 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:55:58.887177 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:55:58.887177 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4b22328-963e-4a51-8ace-087e5b74cb2f could not be found. May 23 16:55:58.887177 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:55:58.887177 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:55:58.887177 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:55:58.887177 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:55:58.887177 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:55:58.887177 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:55:58.887177 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:55:58.887177 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:55:58.887177 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4b22328-963e-4a51-8ace-087e5b74cb2f could not be found. May 23 16:55:58.887177 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:55:58.888560 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-60693e0b-317b-4f2f-96ee-af8ec8e6498b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Returning 404 to user: Instance f4b22328-963e-4a51-8ace-087e5b74cb2f could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:55:58.888560 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-60693e0b-317b-4f2f-96ee-af8ec8e6498b tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 404 len: 111 microversion: 2.1 time: 0.036070 May 23 16:55:58.888560 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 448/872] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:55:58 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:55:58.896604 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-2ebd9a1a-7a8c-4c9b-a6ed-e49eaefddff6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '.version_select at 0x7f224c686ca0>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:55:58.963617 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-2ebd9a1a-7a8c-4c9b-a6ed-e49eaefddff6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-425189219" status: 202 len: 0 microversion: 2.1 time: 0.071699 May 23 16:55:58.964196 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 425/873] 10.222.0.74 () {58 vars in 1217 bytes} [Mon May 23 16:55:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-425189219 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:56:00.956961 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7b05c503-25ec-4368-9233-fa81e2ad6de6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:00.957518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-7b05c503-25ec-4368-9233-fa81e2ad6de6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:00.965536 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7b05c503-25ec-4368-9233-fa81e2ad6de6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:00.966909 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7b05c503-25ec-4368-9233-fa81e2ad6de6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:00.967023 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7b05c503-25ec-4368-9233-fa81e2ad6de6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:00.967377 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7b05c503-25ec-4368-9233-fa81e2ad6de6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:00.982200 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-7b05c503-25ec-4368-9233-fa81e2ad6de6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] HTTP exception thrown: Instance f4b22328-963e-4a51-8ace-087e5b74cb2f could not be found. May 23 16:56:00.983748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7b05c503-25ec-4368-9233-fa81e2ad6de6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Request method failure captured: May 23 16:56:00.983748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: DELETE /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f HTTP/1.1 May 23 16:56:00.983748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:56:00.983748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:56:00.983748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:56:00.983748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:56:00.983748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:56:00.983748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:56:00.983748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:56:00.983748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:56:00.983748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7oyo5VTSnwIFQPT0kTtFaHtIkHFj5L-FdhSIUmX9rttwLCW8jCAZ-X2qSMb7H2nHSgXjB6vWffoOpo-tnDcGctqzpOOjedHQxhH_K6_YUurOv1U6F0vB3iEbd4WjdXEZ7YlGpKqnMbRleSlAkItJeye3e1UHY4m4KuLnUpITA6zvao May 23 16:56:00.983748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:56:00.983748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:56:00.983748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:56:00.983748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:56:00.983748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:56:00.983748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:56:00.983748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:56:00.983748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:00.983748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:56:00.983748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:56:00.993077 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:56:00.993077 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:00.993077 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:56:00.993077 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:00.993077 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:56:00.993077 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:56:00.993077 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:56:00.993077 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: 718a82d2f4294f68965ce01aac0fc166 May 23 16:56:00.993077 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:56:00.993077 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 16:56:00.993077 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Instance f4b22328-963e-4a51-8ace-087e5b74cb2f could not be found. May 23 16:56:00.993077 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': 'f4b22328-963e-4a51-8ace-087e5b74cb2f'} May 23 16:56:00.994152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:56:00.994152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:00.994152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:56:00.994152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:56:00.994152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:56:00.994152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:56:00.994152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:56:00.994152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:56:00.994152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:56:00.994152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:56:00.994152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4b22328-963e-4a51-8ace-087e5b74cb2f could not be found. May 23 16:56:00.994152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:00.994152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:00.994152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:00.994152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:00.994152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:00.994152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:00.994152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:56:00.994152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:56:00.994152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:56:00.995619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:56:00.995619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 16:56:00.995619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 16:56:00.995619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 16:56:00.995619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 16:56:00.995619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:56:00.995619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:56:00.995619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:56:00.995619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:56:00.995619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4b22328-963e-4a51-8ace-087e5b74cb2f could not be found. May 23 16:56:00.995619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:00.995619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:00.995619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:00.995619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:00.995619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:00.995619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:00.995619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:56:00.995619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:56:00.995619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4b22328-963e-4a51-8ace-087e5b74cb2f could not be found. May 23 16:56:00.995619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:00.997189 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7b05c503-25ec-4368-9233-fa81e2ad6de6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Returning 404 to user: Instance f4b22328-963e-4a51-8ace-087e5b74cb2f could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:56:00.997189 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-7b05c503-25ec-4368-9233-fa81e2ad6de6 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "DELETE /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 404 len: 111 microversion: 2.1 time: 0.032868 May 23 16:56:00.997189 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 449/874] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 16:56:00 2022] DELETE /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:56:00.997471 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-50c668e6-0d9f-4aea-bdd1-7363004371cb tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:00.997471 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-50c668e6-0d9f-4aea-bdd1-7363004371cb tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: f4b22328-963e-4a51-8ace-087e5b74cb2f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:01.001909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-50c668e6-0d9f-4aea-bdd1-7363004371cb tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:01.002359 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-50c668e6-0d9f-4aea-bdd1-7363004371cb tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:01.003286 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-50c668e6-0d9f-4aea-bdd1-7363004371cb tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:01.003757 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-50c668e6-0d9f-4aea-bdd1-7363004371cb tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:01.016585 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-50c668e6-0d9f-4aea-bdd1-7363004371cb tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] HTTP exception thrown: Instance f4b22328-963e-4a51-8ace-087e5b74cb2f could not be found. May 23 16:56:01.018203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-50c668e6-0d9f-4aea-bdd1-7363004371cb tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Request method failure captured: May 23 16:56:01.018203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f HTTP/1.1 May 23 16:56:01.018203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:56:01.018203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:56:01.018203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:56:01.018203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 16:56:01.018203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:56:01.018203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:56:01.018203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:56:01.018203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:56:01.018203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7oyo5VTSnwIFQPT0kTtFaHtIkHFj5L-FdhSIUmX9rttwLCW8jCAZ-X2qSMb7H2nHSgXjB6vWffoOpo-tnDcGctqzpOOjedHQxhH_K6_YUurOv1U6F0vB3iEbd4WjdXEZ7YlGpKqnMbRleSlAkItJeye3e1UHY4m4KuLnUpITA6zvao May 23 16:56:01.018203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:56:01.018203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:56:01.018203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:56:01.018203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:56:01.018203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:56:01.018203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:56:01.018203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:56:01.018203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:01.018203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:56:01.018203 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:56:01.020835 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:56:01.020835 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:01.020835 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:56:01.020835 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:01.020835 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:56:01.020835 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:56:01.020835 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:56:01.020835 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 718a82d2f4294f68965ce01aac0fc166 May 23 16:56:01.020835 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:56:01.020835 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: > May 23 16:56:01.020835 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Instance f4b22328-963e-4a51-8ace-087e5b74cb2f could not be found. May 23 16:56:01.020835 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': 'f4b22328-963e-4a51-8ace-087e5b74cb2f'} May 23 16:56:01.021590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:56:01.021590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:01.021590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:56:01.021590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:56:01.021590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:56:01.021590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:56:01.021590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:56:01.021590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:56:01.021590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:56:01.021590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:56:01.021590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4b22328-963e-4a51-8ace-087e5b74cb2f could not be found. May 23 16:56:01.021590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:01.021590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:01.021590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:01.021590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:01.021590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:01.021590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:01.021590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:56:01.021590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:56:01.021590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:56:01.022877 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:56:01.022877 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:56:01.022877 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:56:01.022877 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:56:01.022877 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:56:01.022877 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:56:01.022877 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:56:01.022877 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4b22328-963e-4a51-8ace-087e5b74cb2f could not be found. May 23 16:56:01.022877 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:01.022877 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:01.022877 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:01.022877 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:01.022877 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:01.022877 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:01.022877 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:56:01.022877 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:56:01.022877 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4b22328-963e-4a51-8ace-087e5b74cb2f could not be found. May 23 16:56:01.022877 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:01.023967 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-50c668e6-0d9f-4aea-bdd1-7363004371cb tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Returning 404 to user: Instance f4b22328-963e-4a51-8ace-087e5b74cb2f could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:56:01.023967 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-50c668e6-0d9f-4aea-bdd1-7363004371cb tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f" status: 404 len: 111 microversion: 2.1 time: 0.030039 May 23 16:56:01.023967 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 426/875] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:00 2022] GET /compute/v2.1/servers/f4b22328-963e-4a51-8ace-087e5b74cb2f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:56:02.297759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-41d2e2e3-6d72-4a51-9b35-b94ddd3fafbd tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:02.298391 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-41d2e2e3-6d72-4a51-9b35-b94ddd3fafbd tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:02.306187 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-41d2e2e3-6d72-4a51-9b35-b94ddd3fafbd tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:02.306848 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-41d2e2e3-6d72-4a51-9b35-b94ddd3fafbd tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:02.307627 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-41d2e2e3-6d72-4a51-9b35-b94ddd3fafbd tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:02.308107 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-41d2e2e3-6d72-4a51-9b35-b94ddd3fafbd tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:02.321868 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-41d2e2e3-6d72-4a51-9b35-b94ddd3fafbd tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] HTTP exception thrown: Instance 5df1e0c9-37f3-4752-9e82-553588ceb0b1 could not be found. May 23 16:56:02.323518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-41d2e2e3-6d72-4a51-9b35-b94ddd3fafbd tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Request method failure captured: May 23 16:56:02.323518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: DELETE /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 HTTP/1.1 May 23 16:56:02.323518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:56:02.323518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:56:02.323518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:56:02.323518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:56:02.323518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:56:02.323518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:56:02.323518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:56:02.323518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:56:02.323518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7oyo5VTSnwIFQPT0kTtFaHtIkHFj5L-FdhSIUmX9rttwLCW8jCAZ-X2qSMb7H2nHSgXjB6vWffoOpo-tnDcGctqzpOOjedHQxhH_K6_YUurOv1U6F0vB3iEbd4WjdXEZ7YlGpKqnMbRleSlAkItJeye3e1UHY4m4KuLnUpITA6zvao May 23 16:56:02.323518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:56:02.323518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:56:02.323518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:56:02.323518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:56:02.323518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:56:02.323518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:56:02.323518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:56:02.323518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:02.323518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:56:02.323518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:56:02.325231 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:56:02.325231 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:02.325231 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:56:02.325231 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:02.325231 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:56:02.325231 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:56:02.325231 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:56:02.325231 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: 718a82d2f4294f68965ce01aac0fc166 May 23 16:56:02.325231 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:56:02.325231 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 16:56:02.325231 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Instance 5df1e0c9-37f3-4752-9e82-553588ceb0b1 could not be found. May 23 16:56:02.325231 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': '5df1e0c9-37f3-4752-9e82-553588ceb0b1'} May 23 16:56:02.326299 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:56:02.326299 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:02.326299 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:56:02.326299 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:56:02.326299 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:56:02.326299 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:56:02.326299 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:56:02.326299 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:56:02.326299 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:56:02.326299 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:56:02.326299 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5df1e0c9-37f3-4752-9e82-553588ceb0b1 could not be found. May 23 16:56:02.326299 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:02.326299 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:02.326299 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:02.326299 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:02.326299 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:02.326299 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:02.326299 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:56:02.326299 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:56:02.326299 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:56:02.327788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:56:02.327788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 16:56:02.327788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 16:56:02.327788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 16:56:02.327788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 16:56:02.327788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:56:02.327788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:56:02.327788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:56:02.327788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:56:02.327788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5df1e0c9-37f3-4752-9e82-553588ceb0b1 could not be found. May 23 16:56:02.327788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:02.327788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:02.327788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:02.327788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:02.327788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:02.327788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:02.327788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:56:02.327788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:56:02.327788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5df1e0c9-37f3-4752-9e82-553588ceb0b1 could not be found. May 23 16:56:02.327788 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:02.330114 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-41d2e2e3-6d72-4a51-9b35-b94ddd3fafbd tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Returning 404 to user: Instance 5df1e0c9-37f3-4752-9e82-553588ceb0b1 could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:56:02.330114 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-41d2e2e3-6d72-4a51-9b35-b94ddd3fafbd tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "DELETE /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1" status: 404 len: 111 microversion: 2.1 time: 0.031234 May 23 16:56:02.330114 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 450/876] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 16:56:02 2022] DELETE /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:56:02.334474 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-33aadb64-b7e7-4ec2-a903-90591420c501 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:02.335138 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-33aadb64-b7e7-4ec2-a903-90591420c501 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: 5df1e0c9-37f3-4752-9e82-553588ceb0b1] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:02.346254 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-33aadb64-b7e7-4ec2-a903-90591420c501 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:02.356722 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-33aadb64-b7e7-4ec2-a903-90591420c501 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:02.356722 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-33aadb64-b7e7-4ec2-a903-90591420c501 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:02.356722 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-33aadb64-b7e7-4ec2-a903-90591420c501 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:02.362409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-33aadb64-b7e7-4ec2-a903-90591420c501 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] HTTP exception thrown: Instance 5df1e0c9-37f3-4752-9e82-553588ceb0b1 could not be found. May 23 16:56:02.364010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-33aadb64-b7e7-4ec2-a903-90591420c501 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Request method failure captured: May 23 16:56:02.364010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 HTTP/1.1 May 23 16:56:02.364010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:56:02.364010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:56:02.364010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:56:02.364010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 16:56:02.364010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:56:02.364010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:56:02.364010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:56:02.364010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:56:02.364010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7oyo5VTSnwIFQPT0kTtFaHtIkHFj5L-FdhSIUmX9rttwLCW8jCAZ-X2qSMb7H2nHSgXjB6vWffoOpo-tnDcGctqzpOOjedHQxhH_K6_YUurOv1U6F0vB3iEbd4WjdXEZ7YlGpKqnMbRleSlAkItJeye3e1UHY4m4KuLnUpITA6zvao May 23 16:56:02.364010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:56:02.364010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:56:02.364010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:56:02.364010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:56:02.364010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:56:02.364010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:56:02.364010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:56:02.364010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:02.364010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:56:02.364010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:56:02.365673 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:56:02.365673 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:02.365673 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:56:02.365673 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:02.365673 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:56:02.365673 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:56:02.365673 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:56:02.365673 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 718a82d2f4294f68965ce01aac0fc166 May 23 16:56:02.365673 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:56:02.365673 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: > May 23 16:56:02.365673 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Instance 5df1e0c9-37f3-4752-9e82-553588ceb0b1 could not be found. May 23 16:56:02.365673 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': '5df1e0c9-37f3-4752-9e82-553588ceb0b1'} May 23 16:56:02.366575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:56:02.366575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:02.366575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:56:02.366575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:56:02.366575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:56:02.366575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:56:02.366575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:56:02.366575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:56:02.366575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:56:02.366575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:56:02.366575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5df1e0c9-37f3-4752-9e82-553588ceb0b1 could not be found. May 23 16:56:02.366575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:02.366575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:02.366575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:02.366575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:02.366575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:02.366575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:02.366575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:56:02.366575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:56:02.366575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:56:02.368006 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:56:02.368006 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:56:02.368006 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:56:02.368006 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:56:02.368006 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:56:02.368006 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:56:02.368006 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:56:02.368006 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5df1e0c9-37f3-4752-9e82-553588ceb0b1 could not be found. May 23 16:56:02.368006 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:02.368006 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:02.368006 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:02.368006 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:02.368006 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:02.368006 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:02.368006 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:56:02.368006 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:56:02.368006 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5df1e0c9-37f3-4752-9e82-553588ceb0b1 could not be found. May 23 16:56:02.368006 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:02.369382 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-33aadb64-b7e7-4ec2-a903-90591420c501 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Returning 404 to user: Instance 5df1e0c9-37f3-4752-9e82-553588ceb0b1 could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:56:02.369382 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-33aadb64-b7e7-4ec2-a903-90591420c501 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1" status: 404 len: 111 microversion: 2.1 time: 0.035714 May 23 16:56:02.369382 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 427/877] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:02 2022] GET /compute/v2.1/servers/5df1e0c9-37f3-4752-9e82-553588ceb0b1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 16:56:02.374268 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-450c7e05-eecc-4c50-afbd-932b80385a80 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:02.374767 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-450c7e05-eecc-4c50-afbd-932b80385a80 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:02.381010 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-450c7e05-eecc-4c50-afbd-932b80385a80 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:02.381465 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-450c7e05-eecc-4c50-afbd-932b80385a80 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:02.382241 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-450c7e05-eecc-4c50-afbd-932b80385a80 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:02.382683 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-450c7e05-eecc-4c50-afbd-932b80385a80 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:02.396616 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-450c7e05-eecc-4c50-afbd-932b80385a80 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] HTTP exception thrown: Instance d413ebb5-7e19-40ba-810b-505e89c582ef could not be found. May 23 16:56:02.398129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-450c7e05-eecc-4c50-afbd-932b80385a80 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Request method failure captured: May 23 16:56:02.398129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: DELETE /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef HTTP/1.1 May 23 16:56:02.398129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:56:02.398129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:56:02.398129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:56:02.398129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:56:02.398129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:56:02.398129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:56:02.398129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:56:02.398129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:56:02.398129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7oyo5VTSnwIFQPT0kTtFaHtIkHFj5L-FdhSIUmX9rttwLCW8jCAZ-X2qSMb7H2nHSgXjB6vWffoOpo-tnDcGctqzpOOjedHQxhH_K6_YUurOv1U6F0vB3iEbd4WjdXEZ7YlGpKqnMbRleSlAkItJeye3e1UHY4m4KuLnUpITA6zvao May 23 16:56:02.398129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:56:02.398129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:56:02.398129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:56:02.398129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:56:02.398129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:56:02.398129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:56:02.398129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:56:02.398129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:02.398129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:56:02.398129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:56:02.399700 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:56:02.399700 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:02.399700 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:56:02.399700 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:02.399700 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:56:02.399700 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:56:02.399700 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:56:02.399700 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: 718a82d2f4294f68965ce01aac0fc166 May 23 16:56:02.399700 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:56:02.399700 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 16:56:02.399700 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Instance d413ebb5-7e19-40ba-810b-505e89c582ef could not be found. May 23 16:56:02.399700 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': 'd413ebb5-7e19-40ba-810b-505e89c582ef'} May 23 16:56:02.400541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:56:02.400541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:02.400541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:56:02.400541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:56:02.400541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:56:02.400541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:56:02.400541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:56:02.400541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:56:02.400541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:56:02.400541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:56:02.400541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d413ebb5-7e19-40ba-810b-505e89c582ef could not be found. May 23 16:56:02.400541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:02.400541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:02.400541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:02.400541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:02.400541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:02.400541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:02.400541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:56:02.400541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:56:02.400541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:56:02.401750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:56:02.401750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 16:56:02.401750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 16:56:02.401750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 16:56:02.401750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 16:56:02.401750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:56:02.401750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:56:02.401750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:56:02.401750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:56:02.401750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d413ebb5-7e19-40ba-810b-505e89c582ef could not be found. May 23 16:56:02.401750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:02.401750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:02.401750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:02.401750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:02.401750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:02.401750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:02.401750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:56:02.401750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:56:02.401750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d413ebb5-7e19-40ba-810b-505e89c582ef could not be found. May 23 16:56:02.401750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:02.403000 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-450c7e05-eecc-4c50-afbd-932b80385a80 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Returning 404 to user: Instance d413ebb5-7e19-40ba-810b-505e89c582ef could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:56:02.403000 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-450c7e05-eecc-4c50-afbd-932b80385a80 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "DELETE /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 404 len: 111 microversion: 2.1 time: 0.029317 May 23 16:56:02.403000 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 451/878] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 16:56:02 2022] DELETE /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:56:02.408385 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ed935dc3-8797-43fe-94bb-85888d62bdc2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:02.409099 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ed935dc3-8797-43fe-94bb-85888d62bdc2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: d413ebb5-7e19-40ba-810b-505e89c582ef] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:02.415691 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ed935dc3-8797-43fe-94bb-85888d62bdc2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:02.416153 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ed935dc3-8797-43fe-94bb-85888d62bdc2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:02.417606 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ed935dc3-8797-43fe-94bb-85888d62bdc2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:02.418056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ed935dc3-8797-43fe-94bb-85888d62bdc2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:02.431647 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-ed935dc3-8797-43fe-94bb-85888d62bdc2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] HTTP exception thrown: Instance d413ebb5-7e19-40ba-810b-505e89c582ef could not be found. May 23 16:56:02.433230 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ed935dc3-8797-43fe-94bb-85888d62bdc2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Request method failure captured: May 23 16:56:02.433230 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef HTTP/1.1 May 23 16:56:02.433230 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:56:02.433230 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:56:02.433230 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:56:02.433230 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 16:56:02.433230 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:56:02.433230 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:56:02.433230 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:56:02.433230 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:56:02.433230 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7oyo5VTSnwIFQPT0kTtFaHtIkHFj5L-FdhSIUmX9rttwLCW8jCAZ-X2qSMb7H2nHSgXjB6vWffoOpo-tnDcGctqzpOOjedHQxhH_K6_YUurOv1U6F0vB3iEbd4WjdXEZ7YlGpKqnMbRleSlAkItJeye3e1UHY4m4KuLnUpITA6zvao May 23 16:56:02.433230 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:56:02.433230 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:56:02.433230 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:56:02.433230 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:56:02.433230 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:56:02.433230 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:56:02.433230 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:56:02.433230 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:02.433230 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:56:02.433230 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:56:02.434827 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:56:02.434827 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:02.434827 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:56:02.434827 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:02.434827 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:56:02.434827 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:56:02.434827 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:56:02.434827 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 718a82d2f4294f68965ce01aac0fc166 May 23 16:56:02.434827 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:56:02.434827 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: > May 23 16:56:02.434827 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Instance d413ebb5-7e19-40ba-810b-505e89c582ef could not be found. May 23 16:56:02.434827 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': 'd413ebb5-7e19-40ba-810b-505e89c582ef'} May 23 16:56:02.435649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:56:02.435649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:02.435649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:56:02.435649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:56:02.435649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:56:02.435649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:56:02.435649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:56:02.435649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:56:02.435649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:56:02.435649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:56:02.435649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d413ebb5-7e19-40ba-810b-505e89c582ef could not be found. May 23 16:56:02.435649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:02.435649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:02.435649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:02.435649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:02.435649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:02.435649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:02.435649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:56:02.435649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:56:02.435649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:56:02.436908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:56:02.436908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:56:02.436908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:56:02.436908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:56:02.436908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:56:02.436908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:56:02.436908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:56:02.436908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d413ebb5-7e19-40ba-810b-505e89c582ef could not be found. May 23 16:56:02.436908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:02.436908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:02.436908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:02.436908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:02.436908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:02.436908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:02.436908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:56:02.436908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:56:02.436908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d413ebb5-7e19-40ba-810b-505e89c582ef could not be found. May 23 16:56:02.436908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:02.438024 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ed935dc3-8797-43fe-94bb-85888d62bdc2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Returning 404 to user: Instance d413ebb5-7e19-40ba-810b-505e89c582ef could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:56:02.438024 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ed935dc3-8797-43fe-94bb-85888d62bdc2 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef" status: 404 len: 111 microversion: 2.1 time: 0.030321 May 23 16:56:02.438024 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 428/879] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:02 2022] GET /compute/v2.1/servers/d413ebb5-7e19-40ba-810b-505e89c582ef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:56:03.651014 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-4c95090e-46bd-4367-8cdf-9fe0d41d0739 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:03.651545 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-4c95090e-46bd-4367-8cdf-9fe0d41d0739 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:03.658098 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4c95090e-46bd-4367-8cdf-9fe0d41d0739 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:03.659885 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4c95090e-46bd-4367-8cdf-9fe0d41d0739 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:03.659885 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4c95090e-46bd-4367-8cdf-9fe0d41d0739 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:03.660603 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4c95090e-46bd-4367-8cdf-9fe0d41d0739 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:03.673878 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-4c95090e-46bd-4367-8cdf-9fe0d41d0739 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] HTTP exception thrown: Instance ead45718-a5be-4d14-a83c-b6101b5ebc3c could not be found. May 23 16:56:03.676418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-4c95090e-46bd-4367-8cdf-9fe0d41d0739 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Request method failure captured: May 23 16:56:03.676418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: DELETE /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c HTTP/1.1 May 23 16:56:03.676418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:56:03.676418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:56:03.676418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:56:03.676418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:56:03.676418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:56:03.676418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:56:03.676418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:56:03.676418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:56:03.676418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7oyo5VTSnwIFQPT0kTtFaHtIkHFj5L-FdhSIUmX9rttwLCW8jCAZ-X2qSMb7H2nHSgXjB6vWffoOpo-tnDcGctqzpOOjedHQxhH_K6_YUurOv1U6F0vB3iEbd4WjdXEZ7YlGpKqnMbRleSlAkItJeye3e1UHY4m4KuLnUpITA6zvao May 23 16:56:03.676418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:56:03.676418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:56:03.676418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:56:03.676418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:56:03.676418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:56:03.676418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:56:03.676418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:56:03.676418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:03.676418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:56:03.676418 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:56:03.677995 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:56:03.677995 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:03.677995 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:56:03.677995 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:03.677995 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:56:03.677995 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:56:03.677995 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:56:03.677995 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: 718a82d2f4294f68965ce01aac0fc166 May 23 16:56:03.677995 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:56:03.677995 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 16:56:03.677995 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Instance ead45718-a5be-4d14-a83c-b6101b5ebc3c could not be found. May 23 16:56:03.677995 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': 'ead45718-a5be-4d14-a83c-b6101b5ebc3c'} May 23 16:56:03.678794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:56:03.678794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:03.678794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:56:03.678794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:56:03.678794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:56:03.678794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:56:03.678794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:56:03.678794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:56:03.678794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:56:03.678794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:56:03.678794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ead45718-a5be-4d14-a83c-b6101b5ebc3c could not be found. May 23 16:56:03.678794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:03.678794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:03.678794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:03.678794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:03.678794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:03.678794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:03.678794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:56:03.678794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:56:03.678794 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:56:03.680228 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:56:03.680228 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 16:56:03.680228 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 16:56:03.680228 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 16:56:03.680228 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 16:56:03.680228 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:56:03.680228 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:56:03.680228 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:56:03.680228 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:56:03.680228 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ead45718-a5be-4d14-a83c-b6101b5ebc3c could not be found. May 23 16:56:03.680228 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:03.680228 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:03.680228 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:03.680228 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:03.680228 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:03.680228 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:03.680228 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:56:03.680228 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:56:03.680228 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ead45718-a5be-4d14-a83c-b6101b5ebc3c could not be found. May 23 16:56:03.680228 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:03.681784 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-4c95090e-46bd-4367-8cdf-9fe0d41d0739 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Returning 404 to user: Instance ead45718-a5be-4d14-a83c-b6101b5ebc3c could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:56:03.681784 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-4c95090e-46bd-4367-8cdf-9fe0d41d0739 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "DELETE /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 404 len: 111 microversion: 2.1 time: 0.030748 May 23 16:56:03.681784 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 452/880] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 16:56:03 2022] DELETE /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:56:03.686260 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-8954f39f-c379-4f7e-975e-f150fc113e08 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:03.686877 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-8954f39f-c379-4f7e-975e-f150fc113e08 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] [instance: ead45718-a5be-4d14-a83c-b6101b5ebc3c] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:03.693527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8954f39f-c379-4f7e-975e-f150fc113e08 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:03.693977 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8954f39f-c379-4f7e-975e-f150fc113e08 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:03.694747 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8954f39f-c379-4f7e-975e-f150fc113e08 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:03.695192 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8954f39f-c379-4f7e-975e-f150fc113e08 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:03.710771 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-8954f39f-c379-4f7e-975e-f150fc113e08 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] HTTP exception thrown: Instance ead45718-a5be-4d14-a83c-b6101b5ebc3c could not be found. May 23 16:56:03.712287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-8954f39f-c379-4f7e-975e-f150fc113e08 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Request method failure captured: May 23 16:56:03.712287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c HTTP/1.1 May 23 16:56:03.712287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:56:03.712287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:56:03.712287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:56:03.712287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 16:56:03.712287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:56:03.712287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:56:03.712287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:56:03.712287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:56:03.712287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7oyo5VTSnwIFQPT0kTtFaHtIkHFj5L-FdhSIUmX9rttwLCW8jCAZ-X2qSMb7H2nHSgXjB6vWffoOpo-tnDcGctqzpOOjedHQxhH_K6_YUurOv1U6F0vB3iEbd4WjdXEZ7YlGpKqnMbRleSlAkItJeye3e1UHY4m4KuLnUpITA6zvao May 23 16:56:03.712287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:56:03.712287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:56:03.712287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:56:03.712287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:56:03.712287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:56:03.712287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:56:03.712287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:56:03.712287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:03.712287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:56:03.712287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:56:03.714112 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_e293f2b3de9143ad9e8a1fe8b67d6641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:56:03.714112 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:03.714112 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: e293f2b3de9143ad9e8a1fe8b67d6641 May 23 16:56:03.714112 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257911183 May 23 16:56:03.714112 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:56:03.714112 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:56:03.714112 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:56:03.714112 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 718a82d2f4294f68965ce01aac0fc166 May 23 16:56:03.714112 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-AttachVolumeNegativeTest-1257911183-project May 23 16:56:03.714112 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: > May 23 16:56:03.714112 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Instance ead45718-a5be-4d14-a83c-b6101b5ebc3c could not be found. May 23 16:56:03.714112 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': 'ead45718-a5be-4d14-a83c-b6101b5ebc3c'} May 23 16:56:03.715046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:56:03.715046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:03.715046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:56:03.715046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:56:03.715046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:56:03.715046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:56:03.715046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:56:03.715046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:56:03.715046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:56:03.715046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:56:03.715046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ead45718-a5be-4d14-a83c-b6101b5ebc3c could not be found. May 23 16:56:03.715046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:03.715046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:03.715046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:03.715046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:03.715046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:03.715046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:03.715046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:56:03.715046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:56:03.715046 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:56:03.716537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:56:03.716537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:56:03.716537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:56:03.716537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:56:03.716537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:56:03.716537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:56:03.716537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:56:03.716537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ead45718-a5be-4d14-a83c-b6101b5ebc3c could not be found. May 23 16:56:03.716537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:03.716537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:03.716537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:03.716537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:03.716537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:03.716537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:03.716537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:56:03.716537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:56:03.716537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ead45718-a5be-4d14-a83c-b6101b5ebc3c could not be found. May 23 16:56:03.716537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:03.717911 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-8954f39f-c379-4f7e-975e-f150fc113e08 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] Returning 404 to user: Instance ead45718-a5be-4d14-a83c-b6101b5ebc3c could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:56:03.717911 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-8954f39f-c379-4f7e-975e-f150fc113e08 tempest-AttachVolumeNegativeTest-1257911183 tempest-AttachVolumeNegativeTest-1257911183-project] 10.222.0.74 "GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c" status: 404 len: 111 microversion: 2.1 time: 0.031328 May 23 16:56:03.717911 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 429/881] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:03 2022] GET /compute/v2.1/servers/ead45718-a5be-4d14-a83c-b6101b5ebc3c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:56:07.803065 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-b801a146-2092-4dbc-8df5-bab156f05b29 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:07.804082 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-b801a146-2092-4dbc-8df5-bab156f05b29 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:07.816234 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b801a146-2092-4dbc-8df5-bab156f05b29 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:07.816846 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b801a146-2092-4dbc-8df5-bab156f05b29 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:07.817674 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b801a146-2092-4dbc-8df5-bab156f05b29 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:07.818111 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b801a146-2092-4dbc-8df5-bab156f05b29 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:07.849193 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-b801a146-2092-4dbc-8df5-bab156f05b29 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051858 May 23 16:56:07.849746 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 453/882] 10.222.0.74 () {60 vars in 1342 bytes} [Mon May 23 16:56:07 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:56:07.910493 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-dfbf750d-f0fc-45d2-87eb-2274fcdab0bc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:07.911099 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-dfbf750d-f0fc-45d2-87eb-2274fcdab0bc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:07.917652 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dfbf750d-f0fc-45d2-87eb-2274fcdab0bc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:07.918105 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dfbf750d-f0fc-45d2-87eb-2274fcdab0bc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:07.918871 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dfbf750d-f0fc-45d2-87eb-2274fcdab0bc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:07.919335 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dfbf750d-f0fc-45d2-87eb-2274fcdab0bc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:07.946524 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-dfbf750d-f0fc-45d2-87eb-2274fcdab0bc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Going to try to terminate instance {{(pid=124714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 16:56:08.251467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-dfbf750d-f0fc-45d2-87eb-2274fcdab0bc tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "DELETE /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 204 len: 0 microversion: 2.20 time: 0.344691 May 23 16:56:08.252156 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 430/883] 10.222.0.74 () {60 vars in 1279 bytes} [Mon May 23 16:56:07 2022] DELETE /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 16:56:08.261902 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-32adf23d-a795-4a05-847d-a1977203bce0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:08.262648 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-32adf23d-a795-4a05-847d-a1977203bce0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:08.270374 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-32adf23d-a795-4a05-847d-a1977203bce0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:08.271624 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-32adf23d-a795-4a05-847d-a1977203bce0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:08.272613 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-32adf23d-a795-4a05-847d-a1977203bce0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:08.273219 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-32adf23d-a795-4a05-847d-a1977203bce0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:08.414024 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-32adf23d-a795-4a05-847d-a1977203bce0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:08.423772 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-32adf23d-a795-4a05-847d-a1977203bce0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:08.426576 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-32adf23d-a795-4a05-847d-a1977203bce0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:08.427763 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-32adf23d-a795-4a05-847d-a1977203bce0 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1721 microversion: 2.20 time: 0.170482 May 23 16:56:08.428385 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 454/884] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:56:08 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:56:09.447086 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-97015545-2113-4dfe-8b16-3e6e190f2470 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:09.447789 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-97015545-2113-4dfe-8b16-3e6e190f2470 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:09.451282 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:09.454739 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-97015545-2113-4dfe-8b16-3e6e190f2470 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:09.455190 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-97015545-2113-4dfe-8b16-3e6e190f2470 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:09.456827 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-97015545-2113-4dfe-8b16-3e6e190f2470 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:09.457273 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-97015545-2113-4dfe-8b16-3e6e190f2470 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:09.596705 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-97015545-2113-4dfe-8b16-3e6e190f2470 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:09.606160 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-97015545-2113-4dfe-8b16-3e6e190f2470 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:09.607885 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-97015545-2113-4dfe-8b16-3e6e190f2470 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:09.609180 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-97015545-2113-4dfe-8b16-3e6e190f2470 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1721 microversion: 2.20 time: 0.166275 May 23 16:56:09.609738 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 431/885] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:56:09 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:56:10.614353 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-419c18f1-9786-4839-a88d-0f02f4be4f21 req-5de0428e-4026-4d8d-b65c-bb56d876e1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa18b171-8b37-4fcc-b7e9-e50494e967af", "name": "network-vif-deleted", "tag": "7fc3fb4c-c736-453c-a8e0-bd34a6233442"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:56:10.623886 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-419c18f1-9786-4839-a88d-0f02f4be4f21 req-5de0428e-4026-4d8d-b65c-bb56d876e1f9 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:10.624658 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-419c18f1-9786-4839-a88d-0f02f4be4f21 req-5de0428e-4026-4d8d-b65c-bb56d876e1f9 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:10.627061 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-82eb2689-6147-433a-b340-bcef3769b79e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:10.627982 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-82eb2689-6147-433a-b340-bcef3769b79e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:10.635704 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-82eb2689-6147-433a-b340-bcef3769b79e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:10.636153 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-82eb2689-6147-433a-b340-bcef3769b79e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:10.636974 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-82eb2689-6147-433a-b340-bcef3769b79e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:10.637599 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-82eb2689-6147-433a-b340-bcef3769b79e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:10.638136 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-419c18f1-9786-4839-a88d-0f02f4be4f21 req-5de0428e-4026-4d8d-b65c-bb56d876e1f9 service nova] Creating event network-vif-deleted:7fc3fb4c-c736-453c-a8e0-bd34a6233442 for instance fa18b171-8b37-4fcc-b7e9-e50494e967af on hv-cinder-83925 May 23 16:56:10.644557 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-419c18f1-9786-4839-a88d-0f02f4be4f21 req-5de0428e-4026-4d8d-b65c-bb56d876e1f9 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034044 May 23 16:56:10.645881 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 455/886] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:56:10.706463 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-82eb2689-6147-433a-b340-bcef3769b79e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:10.719788 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-82eb2689-6147-433a-b340-bcef3769b79e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:10.719788 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-82eb2689-6147-433a-b340-bcef3769b79e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29e2a2fa32cd4fb7837bdec1d83cb9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f9f16bd2494b7999c25509f804d794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:10.721242 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-82eb2689-6147-433a-b340-bcef3769b79e tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 200 len: 1654 microversion: 2.20 time: 0.097940 May 23 16:56:10.722854 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 432/887] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:56:10 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 1654 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 16:56:11.741570 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-dad91f84-22b1-495f-aade-583744dfa230 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:11.742278 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-dad91f84-22b1-495f-aade-583744dfa230 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:11.748927 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dad91f84-22b1-495f-aade-583744dfa230 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:11.749382 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dad91f84-22b1-495f-aade-583744dfa230 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:11.750155 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dad91f84-22b1-495f-aade-583744dfa230 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:11.750604 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dad91f84-22b1-495f-aade-583744dfa230 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:11.764666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-dad91f84-22b1-495f-aade-583744dfa230 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] HTTP exception thrown: Instance fa18b171-8b37-4fcc-b7e9-e50494e967af could not be found. May 23 16:56:11.766314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-dad91f84-22b1-495f-aade-583744dfa230 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Request method failure captured: May 23 16:56:11.766314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af HTTP/1.1 May 23 16:56:11.766314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:56:11.766314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:56:11.766314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:56:11.766314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:56:11.766314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:56:11.766314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:56:11.766314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:56:11.766314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:56:11.766314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7o6m3x67e92BxzHEqdANve4dtN5kIYKdc9ZplckRWClhMNnQyV4nIhYlhri--LL7Oiteh4B5AbfZZqCbd1e5Dj38qIQq3sq8CbzuSFBdKAUuB_MzVK__CkUcKIwMshj-ggf6o1vgWHsstT_-OIHX_m8EccBvOwFOqxe88IuQT1fBNU May 23 16:56:11.766314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:56:11.766314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:56:11.766314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:56:11.766314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:56:11.766314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Openstack-Nova-Api-Version: 2.20 May 23 16:56:11.766314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:56:11.766314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:56:11.766314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: 60f9f16bd2494b7999c25509f804d794 May 23 16:56:11.766314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-122496734 May 23 16:56:11.766314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:56:11.766314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:56:11.768001 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/60f9f16bd2494b7999c25509f804d794"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/60f9f16bd2494b7999c25509f804d794"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/60f9f16bd2494b7999c25509f804d794"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_60f9f16bd2494b7999c25509f804d794"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:56:11.768001 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-AttachVolumeShelveTestJSON-122496734 May 23 16:56:11.768001 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: 60f9f16bd2494b7999c25509f804d794 May 23 16:56:11.768001 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-122496734 May 23 16:56:11.768001 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-AttachVolumeShelveTestJSON-122496734-project May 23 16:56:11.768001 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:56:11.768001 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:56:11.768001 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: 29e2a2fa32cd4fb7837bdec1d83cb9da May 23 16:56:11.768001 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-AttachVolumeShelveTestJSON-122496734-project May 23 16:56:11.768001 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 16:56:11.768001 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Instance fa18b171-8b37-4fcc-b7e9-e50494e967af could not be found. May 23 16:56:11.768001 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': 'fa18b171-8b37-4fcc-b7e9-e50494e967af'} May 23 16:56:11.769011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:56:11.769011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:11.769011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:56:11.769011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:56:11.769011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:56:11.769011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:56:11.769011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:56:11.769011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:56:11.769011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:56:11.769011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:56:11.769011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa18b171-8b37-4fcc-b7e9-e50494e967af could not be found. May 23 16:56:11.769011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:11.769011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:11.769011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:11.769011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:11.769011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:11.769011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:11.769011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:56:11.769011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:56:11.769011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:56:11.770590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:56:11.770590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:56:11.770590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:56:11.770590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:56:11.770590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:56:11.770590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:56:11.770590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:56:11.770590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa18b171-8b37-4fcc-b7e9-e50494e967af could not be found. May 23 16:56:11.770590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:11.770590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:11.770590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:11.770590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:11.770590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:11.770590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:11.770590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:56:11.770590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:56:11.770590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa18b171-8b37-4fcc-b7e9-e50494e967af could not be found. May 23 16:56:11.770590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:11.772167 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-dad91f84-22b1-495f-aade-583744dfa230 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Returning 404 to user: Instance fa18b171-8b37-4fcc-b7e9-e50494e967af could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:56:11.772167 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-dad91f84-22b1-495f-aade-583744dfa230 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 404 len: 111 microversion: 2.20 time: 0.031056 May 23 16:56:11.772167 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 456/888] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:56:11 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 16:56:11.777075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-cbfe0d3a-8f3c-47b7-8898-abf241f6b825 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '.version_select at 0x7f224c633790>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:11.878215 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-cbfe0d3a-8f3c-47b7-8898-abf241f6b825 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-395537274" status: 204 len: 0 microversion: 2.20 time: 0.104707 May 23 16:56:11.879277 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 433/889] 10.222.0.74 () {60 vars in 1258 bytes} [Mon May 23 16:56:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-395537274 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 16:56:13.934478 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-3d24c71c-7944-4eb7-be51-95d46f71477c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:13.935719 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-3d24c71c-7944-4eb7-be51-95d46f71477c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:13.945627 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3d24c71c-7944-4eb7-be51-95d46f71477c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:13.948435 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3d24c71c-7944-4eb7-be51-95d46f71477c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:13.948435 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3d24c71c-7944-4eb7-be51-95d46f71477c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:13.949282 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3d24c71c-7944-4eb7-be51-95d46f71477c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:13.966850 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-3d24c71c-7944-4eb7-be51-95d46f71477c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] HTTP exception thrown: Instance fa18b171-8b37-4fcc-b7e9-e50494e967af could not be found. May 23 16:56:13.968649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-3d24c71c-7944-4eb7-be51-95d46f71477c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Request method failure captured: May 23 16:56:13.968649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: DELETE /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af HTTP/1.1 May 23 16:56:13.968649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:56:13.968649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:56:13.968649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:56:13.968649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:56:13.968649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:56:13.968649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:56:13.968649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:56:13.968649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:56:13.968649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7o6m3x67e92BxzHEqdANve4dtN5kIYKdc9ZplckRWClhMNnQyV4nIhYlhri--LL7Oiteh4B5AbfZZqCbd1e5Dj38qIQq3sq8CbzuSFBdKAUuB_MzVK__CkUcKIwMshj-ggf6o1vgWHsstT_-OIHX_m8EccBvOwFOqxe88IuQT1fBNU May 23 16:56:13.968649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:56:13.968649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:56:13.968649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:56:13.968649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:56:13.968649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Openstack-Nova-Api-Version: 2.20 May 23 16:56:13.968649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:56:13.968649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:56:13.968649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: 60f9f16bd2494b7999c25509f804d794 May 23 16:56:13.968649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-122496734 May 23 16:56:13.968649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:56:13.968649 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:56:13.970637 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/60f9f16bd2494b7999c25509f804d794"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/60f9f16bd2494b7999c25509f804d794"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/60f9f16bd2494b7999c25509f804d794"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_60f9f16bd2494b7999c25509f804d794"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:56:13.970637 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-AttachVolumeShelveTestJSON-122496734 May 23 16:56:13.970637 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: 60f9f16bd2494b7999c25509f804d794 May 23 16:56:13.970637 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-122496734 May 23 16:56:13.970637 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-AttachVolumeShelveTestJSON-122496734-project May 23 16:56:13.970637 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:56:13.970637 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:56:13.970637 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: 29e2a2fa32cd4fb7837bdec1d83cb9da May 23 16:56:13.970637 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-AttachVolumeShelveTestJSON-122496734-project May 23 16:56:13.970637 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 16:56:13.970637 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Instance fa18b171-8b37-4fcc-b7e9-e50494e967af could not be found. May 23 16:56:13.970637 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': 'fa18b171-8b37-4fcc-b7e9-e50494e967af'} May 23 16:56:13.972139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:56:13.972139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:13.972139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:56:13.972139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:56:13.972139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:56:13.972139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:56:13.972139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:56:13.972139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:56:13.972139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:56:13.972139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:56:13.972139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa18b171-8b37-4fcc-b7e9-e50494e967af could not be found. May 23 16:56:13.972139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:13.972139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:13.972139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:13.972139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:13.972139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:13.972139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:13.972139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:56:13.972139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:56:13.972139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:56:13.973392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:56:13.973392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 16:56:13.973392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 16:56:13.973392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 16:56:13.973392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 16:56:13.973392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:56:13.973392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:56:13.973392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:56:13.973392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:56:13.973392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa18b171-8b37-4fcc-b7e9-e50494e967af could not be found. May 23 16:56:13.973392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:13.973392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:13.973392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:13.973392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:13.973392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:13.973392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:13.973392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:56:13.973392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:56:13.973392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa18b171-8b37-4fcc-b7e9-e50494e967af could not be found. May 23 16:56:13.973392 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:13.974765 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-3d24c71c-7944-4eb7-be51-95d46f71477c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Returning 404 to user: Instance fa18b171-8b37-4fcc-b7e9-e50494e967af could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:56:13.974765 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-3d24c71c-7944-4eb7-be51-95d46f71477c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "DELETE /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 404 len: 111 microversion: 2.20 time: 0.041364 May 23 16:56:13.974765 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 457/890] 10.222.0.74 () {60 vars in 1279 bytes} [Mon May 23 16:56:13 2022] DELETE /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 16:56:13.981490 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-be8ba7a1-7c12-4106-a37d-f25c2e500e94 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:13.982340 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-be8ba7a1-7c12-4106-a37d-f25c2e500e94 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: fa18b171-8b37-4fcc-b7e9-e50494e967af] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:13.991360 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-be8ba7a1-7c12-4106-a37d-f25c2e500e94 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:13.991955 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-be8ba7a1-7c12-4106-a37d-f25c2e500e94 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:13.993044 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-be8ba7a1-7c12-4106-a37d-f25c2e500e94 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:13.993762 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-be8ba7a1-7c12-4106-a37d-f25c2e500e94 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:14.009181 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-be8ba7a1-7c12-4106-a37d-f25c2e500e94 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] HTTP exception thrown: Instance fa18b171-8b37-4fcc-b7e9-e50494e967af could not be found. May 23 16:56:14.011000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-be8ba7a1-7c12-4106-a37d-f25c2e500e94 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Request method failure captured: May 23 16:56:14.011000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af HTTP/1.1 May 23 16:56:14.011000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:56:14.011000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:56:14.011000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:56:14.011000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 16:56:14.011000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:56:14.011000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:56:14.011000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:56:14.011000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:56:14.011000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7o6m3x67e92BxzHEqdANve4dtN5kIYKdc9ZplckRWClhMNnQyV4nIhYlhri--LL7Oiteh4B5AbfZZqCbd1e5Dj38qIQq3sq8CbzuSFBdKAUuB_MzVK__CkUcKIwMshj-ggf6o1vgWHsstT_-OIHX_m8EccBvOwFOqxe88IuQT1fBNU May 23 16:56:14.011000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:56:14.011000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:56:14.011000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:56:14.011000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:56:14.011000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Openstack-Nova-Api-Version: 2.20 May 23 16:56:14.011000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:56:14.011000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:56:14.011000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: 60f9f16bd2494b7999c25509f804d794 May 23 16:56:14.011000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-122496734 May 23 16:56:14.011000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:56:14.011000 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:56:14.012725 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/60f9f16bd2494b7999c25509f804d794"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/60f9f16bd2494b7999c25509f804d794"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/60f9f16bd2494b7999c25509f804d794"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_60f9f16bd2494b7999c25509f804d794"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:56:14.012725 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-AttachVolumeShelveTestJSON-122496734 May 23 16:56:14.012725 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: 60f9f16bd2494b7999c25509f804d794 May 23 16:56:14.012725 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-122496734 May 23 16:56:14.012725 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-AttachVolumeShelveTestJSON-122496734-project May 23 16:56:14.012725 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:56:14.012725 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:56:14.012725 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 29e2a2fa32cd4fb7837bdec1d83cb9da May 23 16:56:14.012725 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-AttachVolumeShelveTestJSON-122496734-project May 23 16:56:14.012725 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: > May 23 16:56:14.012725 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Instance fa18b171-8b37-4fcc-b7e9-e50494e967af could not be found. May 23 16:56:14.012725 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': 'fa18b171-8b37-4fcc-b7e9-e50494e967af'} May 23 16:56:14.013623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:56:14.013623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:14.013623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:56:14.013623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:56:14.013623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:56:14.013623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:56:14.013623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:56:14.013623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:56:14.013623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:56:14.013623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:56:14.013623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa18b171-8b37-4fcc-b7e9-e50494e967af could not be found. May 23 16:56:14.013623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:14.013623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:14.013623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:14.013623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:14.013623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:14.013623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:14.013623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:56:14.013623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:56:14.013623 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:56:14.015500 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:56:14.015500 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:56:14.015500 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:56:14.015500 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:56:14.015500 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:56:14.015500 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:56:14.015500 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:56:14.015500 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa18b171-8b37-4fcc-b7e9-e50494e967af could not be found. May 23 16:56:14.015500 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:14.015500 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:14.015500 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:14.015500 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:14.015500 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:14.015500 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:14.015500 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:56:14.015500 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:56:14.015500 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa18b171-8b37-4fcc-b7e9-e50494e967af could not be found. May 23 16:56:14.015500 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:14.018551 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-be8ba7a1-7c12-4106-a37d-f25c2e500e94 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Returning 404 to user: Instance fa18b171-8b37-4fcc-b7e9-e50494e967af could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:56:14.018551 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-be8ba7a1-7c12-4106-a37d-f25c2e500e94 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af" status: 404 len: 111 microversion: 2.20 time: 0.035835 May 23 16:56:14.018551 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 434/891] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:56:13 2022] GET /compute/v2.1/servers/fa18b171-8b37-4fcc-b7e9-e50494e967af => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 16:56:15.358394 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-629b3924-4600-4565-b8e8-236b0e9fc464 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:15.358992 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-629b3924-4600-4565-b8e8-236b0e9fc464 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:15.365982 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-629b3924-4600-4565-b8e8-236b0e9fc464 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:15.366442 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-629b3924-4600-4565-b8e8-236b0e9fc464 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:15.367209 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-629b3924-4600-4565-b8e8-236b0e9fc464 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:15.367648 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-629b3924-4600-4565-b8e8-236b0e9fc464 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:15.380889 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-629b3924-4600-4565-b8e8-236b0e9fc464 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] HTTP exception thrown: Instance bb302c29-c30d-4ffa-af9d-1f226fd56357 could not be found. May 23 16:56:15.382417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-629b3924-4600-4565-b8e8-236b0e9fc464 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Request method failure captured: May 23 16:56:15.382417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: DELETE /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 HTTP/1.1 May 23 16:56:15.382417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:56:15.382417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:56:15.382417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:56:15.382417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:56:15.382417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:56:15.382417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:56:15.382417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:56:15.382417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:56:15.382417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7o6m3x67e92BxzHEqdANve4dtN5kIYKdc9ZplckRWClhMNnQyV4nIhYlhri--LL7Oiteh4B5AbfZZqCbd1e5Dj38qIQq3sq8CbzuSFBdKAUuB_MzVK__CkUcKIwMshj-ggf6o1vgWHsstT_-OIHX_m8EccBvOwFOqxe88IuQT1fBNU May 23 16:56:15.382417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:56:15.382417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:56:15.382417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:56:15.382417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:56:15.382417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Openstack-Nova-Api-Version: 2.20 May 23 16:56:15.382417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:56:15.382417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:56:15.382417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: 60f9f16bd2494b7999c25509f804d794 May 23 16:56:15.382417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-122496734 May 23 16:56:15.382417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:56:15.382417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:56:15.384021 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/60f9f16bd2494b7999c25509f804d794"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/60f9f16bd2494b7999c25509f804d794"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/60f9f16bd2494b7999c25509f804d794"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_60f9f16bd2494b7999c25509f804d794"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:56:15.384021 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-AttachVolumeShelveTestJSON-122496734 May 23 16:56:15.384021 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: 60f9f16bd2494b7999c25509f804d794 May 23 16:56:15.384021 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-122496734 May 23 16:56:15.384021 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-AttachVolumeShelveTestJSON-122496734-project May 23 16:56:15.384021 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:56:15.384021 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:56:15.384021 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: 29e2a2fa32cd4fb7837bdec1d83cb9da May 23 16:56:15.384021 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-AttachVolumeShelveTestJSON-122496734-project May 23 16:56:15.384021 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 16:56:15.384021 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Instance bb302c29-c30d-4ffa-af9d-1f226fd56357 could not be found. May 23 16:56:15.384021 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': 'bb302c29-c30d-4ffa-af9d-1f226fd56357'} May 23 16:56:15.384956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:56:15.384956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:15.384956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:56:15.384956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:56:15.384956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:56:15.384956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:56:15.384956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:56:15.384956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:56:15.384956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:56:15.384956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:56:15.384956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb302c29-c30d-4ffa-af9d-1f226fd56357 could not be found. May 23 16:56:15.384956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:15.384956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:15.384956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:15.384956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:15.384956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:15.384956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:15.384956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:56:15.384956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:56:15.384956 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:56:15.386453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:56:15.386453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 16:56:15.386453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 16:56:15.386453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 16:56:15.386453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 16:56:15.386453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:56:15.386453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:56:15.386453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:56:15.386453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:56:15.386453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb302c29-c30d-4ffa-af9d-1f226fd56357 could not be found. May 23 16:56:15.386453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:15.386453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:15.386453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:15.386453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:15.386453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:15.386453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:15.386453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:56:15.386453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:56:15.386453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb302c29-c30d-4ffa-af9d-1f226fd56357 could not be found. May 23 16:56:15.386453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:15.387929 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-629b3924-4600-4565-b8e8-236b0e9fc464 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Returning 404 to user: Instance bb302c29-c30d-4ffa-af9d-1f226fd56357 could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:56:15.387929 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-629b3924-4600-4565-b8e8-236b0e9fc464 tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "DELETE /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 404 len: 111 microversion: 2.20 time: 0.029397 May 23 16:56:15.387929 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 458/892] 10.222.0.74 () {60 vars in 1279 bytes} [Mon May 23 16:56:15 2022] DELETE /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 16:56:15.392383 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-0c561d26-6787-43de-9861-1cddfcc3965c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:15.393039 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-0c561d26-6787-43de-9861-1cddfcc3965c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] [instance: bb302c29-c30d-4ffa-af9d-1f226fd56357] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:15.399819 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0c561d26-6787-43de-9861-1cddfcc3965c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:15.404664 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0c561d26-6787-43de-9861-1cddfcc3965c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:15.404664 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0c561d26-6787-43de-9861-1cddfcc3965c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:15.404664 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0c561d26-6787-43de-9861-1cddfcc3965c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:15.416574 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-0c561d26-6787-43de-9861-1cddfcc3965c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] HTTP exception thrown: Instance bb302c29-c30d-4ffa-af9d-1f226fd56357 could not be found. May 23 16:56:15.418134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-0c561d26-6787-43de-9861-1cddfcc3965c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Request method failure captured: May 23 16:56:15.418134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 HTTP/1.1 May 23 16:56:15.418134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:56:15.418134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:56:15.418134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:56:15.418134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 16:56:15.418134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:56:15.418134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:56:15.418134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:56:15.418134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:56:15.418134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7o6m3x67e92BxzHEqdANve4dtN5kIYKdc9ZplckRWClhMNnQyV4nIhYlhri--LL7Oiteh4B5AbfZZqCbd1e5Dj38qIQq3sq8CbzuSFBdKAUuB_MzVK__CkUcKIwMshj-ggf6o1vgWHsstT_-OIHX_m8EccBvOwFOqxe88IuQT1fBNU May 23 16:56:15.418134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:56:15.418134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:56:15.418134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:56:15.418134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:56:15.418134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Openstack-Nova-Api-Version: 2.20 May 23 16:56:15.418134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:56:15.418134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:56:15.418134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: 60f9f16bd2494b7999c25509f804d794 May 23 16:56:15.418134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-122496734 May 23 16:56:15.418134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:56:15.418134 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:56:15.419579 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/60f9f16bd2494b7999c25509f804d794"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/60f9f16bd2494b7999c25509f804d794"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/60f9f16bd2494b7999c25509f804d794"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_60f9f16bd2494b7999c25509f804d794"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:56:15.419579 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-AttachVolumeShelveTestJSON-122496734 May 23 16:56:15.419579 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: 60f9f16bd2494b7999c25509f804d794 May 23 16:56:15.419579 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-122496734 May 23 16:56:15.419579 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-AttachVolumeShelveTestJSON-122496734-project May 23 16:56:15.419579 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:56:15.419579 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:56:15.419579 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 29e2a2fa32cd4fb7837bdec1d83cb9da May 23 16:56:15.419579 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-AttachVolumeShelveTestJSON-122496734-project May 23 16:56:15.419579 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: > May 23 16:56:15.419579 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Instance bb302c29-c30d-4ffa-af9d-1f226fd56357 could not be found. May 23 16:56:15.419579 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': 'bb302c29-c30d-4ffa-af9d-1f226fd56357'} May 23 16:56:15.420467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:56:15.420467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:15.420467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:56:15.420467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:56:15.420467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:56:15.420467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:56:15.420467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:56:15.420467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:56:15.420467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:56:15.420467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:56:15.420467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb302c29-c30d-4ffa-af9d-1f226fd56357 could not be found. May 23 16:56:15.420467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:15.420467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:15.420467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:15.420467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:15.420467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:15.420467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:15.420467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:56:15.420467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:56:15.420467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:56:15.421737 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:56:15.421737 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:56:15.421737 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:56:15.421737 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:56:15.421737 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:56:15.421737 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:56:15.421737 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:56:15.421737 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb302c29-c30d-4ffa-af9d-1f226fd56357 could not be found. May 23 16:56:15.421737 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:15.421737 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:15.421737 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:15.421737 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:15.421737 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:15.421737 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:15.421737 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:56:15.421737 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:56:15.421737 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb302c29-c30d-4ffa-af9d-1f226fd56357 could not be found. May 23 16:56:15.421737 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:15.424436 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-0c561d26-6787-43de-9861-1cddfcc3965c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] Returning 404 to user: Instance bb302c29-c30d-4ffa-af9d-1f226fd56357 could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:56:15.424436 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-0c561d26-6787-43de-9861-1cddfcc3965c tempest-AttachVolumeShelveTestJSON-122496734 tempest-AttachVolumeShelveTestJSON-122496734-project] 10.222.0.74 "GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357" status: 404 len: 111 microversion: 2.20 time: 0.031149 May 23 16:56:15.424436 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 435/893] 10.222.0.74 () {60 vars in 1276 bytes} [Mon May 23 16:56:15 2022] GET /compute/v2.1/servers/bb302c29-c30d-4ffa-af9d-1f226fd56357 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 16:56:21.350083 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-8ffb346e-93b9-403e-a624-edb54629068a tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Action: 'create', calling method: .version_select at 0x7f224c551e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-376163892"}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:56:21.960235 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-8ffb346e-93b9-403e-a624-edb54629068a tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.726822 May 23 16:56:21.960916 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 459/894] 10.222.0.74 () {60 vars in 1154 bytes} [Mon May 23 16:56:21 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 728 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 23 16:56:21.972122 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-81111367-83c6-4fc8-9174-0d182728b9e4 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Calling method '.version_select at 0x7f224c2e7940>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:22.027420 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-81111367-83c6-4fc8-9174-0d182728b9e4 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/683cfc9e-5f15-4bf0-857f-f32a73567b48" status: 200 len: 344 microversion: 2.1 time: 0.059283 May 23 16:56:22.028211 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 436/895] 10.222.0.74 () {58 vars in 1244 bytes} [Mon May 23 16:56:21 2022] GET /compute/v2.1/os-volumes/683cfc9e-5f15-4bf0-857f-f32a73567b48 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:56:23.041220 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-6674ddbd-41f8-4231-9714-26564b6846e4 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Calling method '.version_select at 0x7f224c37f0d0>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:23.093824 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-6674ddbd-41f8-4231-9714-26564b6846e4 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/683cfc9e-5f15-4bf0-857f-f32a73567b48" status: 200 len: 345 microversion: 2.1 time: 0.057206 May 23 16:56:23.094540 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 460/896] 10.222.0.74 () {58 vars in 1244 bytes} [Mon May 23 16:56:23 2022] GET /compute/v2.1/os-volumes/683cfc9e-5f15-4bf0-857f-f32a73567b48 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:56:23.106622 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-c7f18abb-7101-43d6-a895-51a820a699fe tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Action: 'create', calling method: .version_select at 0x7f224c633ca0>, body: {"snapshot": {"volume_id": "683cfc9e-5f15-4bf0-857f-f32a73567b48", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1434644608"}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:56:23.573478 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-c7f18abb-7101-43d6-a895-51a820a699fe tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] 10.222.0.74 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.471451 May 23 16:56:23.575499 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 437/897] 10.222.0.74 () {60 vars in 1161 bytes} [Mon May 23 16:56:23 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:56:23.587313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-ff976e1d-f5ce-4f18-9f0e-8cb620b44bf3 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Calling method '.version_select at 0x7f224c791040>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:23.629777 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-ff976e1d-f5ce-4f18-9f0e-8cb620b44bf3 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/fc03fb3a-ef74-4844-8b89-48f2ca84967d" status: 200 len: 287 microversion: 2.1 time: 0.047611 May 23 16:56:23.630444 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 461/898] 10.222.0.74 () {58 vars in 1250 bytes} [Mon May 23 16:56:23 2022] GET /compute/v2.1/os-snapshots/fc03fb3a-ef74-4844-8b89-48f2ca84967d => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:56:23.640012 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-f3354efa-5633-4b05-9e8f-34108e38b955 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Calling method '.version_select at 0x7f224c653160>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:23.677086 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-f3354efa-5633-4b05-9e8f-34108e38b955 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.040759 May 23 16:56:23.680942 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 438/899] 10.222.0.74 () {58 vars in 1139 bytes} [Mon May 23 16:56:23 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:56:23.689172 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-850dc9ea-d569-4865-b799-c8db9b1537a8 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Calling method '.version_select at 0x7f224c4a6670>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:23.720381 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-850dc9ea-d569-4865-b799-c8db9b1537a8 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/fc03fb3a-ef74-4844-8b89-48f2ca84967d" status: 200 len: 287 microversion: 2.1 time: 0.035891 May 23 16:56:23.721818 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 462/900] 10.222.0.74 () {58 vars in 1250 bytes} [Mon May 23 16:56:23 2022] GET /compute/v2.1/os-snapshots/fc03fb3a-ef74-4844-8b89-48f2ca84967d => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:56:24.732857 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-d0fd0061-7c2e-44d8-a2bc-2692f893313b tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Calling method '.version_select at 0x7f224c6fed30>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:24.762477 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-d0fd0061-7c2e-44d8-a2bc-2692f893313b tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/fc03fb3a-ef74-4844-8b89-48f2ca84967d" status: 200 len: 287 microversion: 2.1 time: 0.034032 May 23 16:56:24.763048 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 439/901] 10.222.0.74 () {58 vars in 1250 bytes} [Mon May 23 16:56:24 2022] GET /compute/v2.1/os-snapshots/fc03fb3a-ef74-4844-8b89-48f2ca84967d => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:56:25.772033 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:25.772829 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=31 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:25.776718 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a396557e-e9da-4d9b-9176-e3202ae4ec70 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Calling method '.version_select at 0x7f224c551430>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:25.809054 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a396557e-e9da-4d9b-9176-e3202ae4ec70 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/fc03fb3a-ef74-4844-8b89-48f2ca84967d" status: 200 len: 287 microversion: 2.1 time: 0.038385 May 23 16:56:25.809627 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 463/902] 10.222.0.74 () {58 vars in 1250 bytes} [Mon May 23 16:56:25 2022] GET /compute/v2.1/os-snapshots/fc03fb3a-ef74-4844-8b89-48f2ca84967d => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:56:26.821700 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:26.821700 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=70,nova_cell1:UPDATE=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:26.826178 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-de2d9ff8-7b89-4e8c-bef7-73dd021b3ad4 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Calling method '.version_select at 0x7f224c407ee0>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:26.857500 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-de2d9ff8-7b89-4e8c-bef7-73dd021b3ad4 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/fc03fb3a-ef74-4844-8b89-48f2ca84967d" status: 200 len: 287 microversion: 2.1 time: 0.040014 May 23 16:56:26.858075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 440/903] 10.222.0.74 () {58 vars in 1250 bytes} [Mon May 23 16:56:26 2022] GET /compute/v2.1/os-snapshots/fc03fb3a-ef74-4844-8b89-48f2ca84967d => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:56:27.869843 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-99cd76d6-67a3-4f6f-b5ee-53451c8a7b51 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Calling method '.version_select at 0x7f224c4a6c10>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:27.899088 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-99cd76d6-67a3-4f6f-b5ee-53451c8a7b51 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/fc03fb3a-ef74-4844-8b89-48f2ca84967d" status: 200 len: 288 microversion: 2.1 time: 0.034149 May 23 16:56:27.899676 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 464/904] 10.222.0.74 () {58 vars in 1250 bytes} [Mon May 23 16:56:27 2022] GET /compute/v2.1/os-snapshots/fc03fb3a-ef74-4844-8b89-48f2ca84967d => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:56:27.911183 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ab3d4445-6594-4761-a284-5bb1ee3b323c tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Calling method '.version_select at 0x7f224c6fe9d0>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:28.040495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ab3d4445-6594-4761-a284-5bb1ee3b323c tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] 10.222.0.74 "DELETE /compute/v2.1/os-snapshots/fc03fb3a-ef74-4844-8b89-48f2ca84967d" status: 202 len: 0 microversion: 2.1 time: 0.131649 May 23 16:56:28.040495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 441/905] 10.222.0.74 () {58 vars in 1253 bytes} [Mon May 23 16:56:27 2022] DELETE /compute/v2.1/os-snapshots/fc03fb3a-ef74-4844-8b89-48f2ca84967d => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:56:28.047243 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-b55e3f2c-b09a-4144-9d63-dc5c694e3559 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Calling method '.version_select at 0x7f224c4c3dc0>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:28.078557 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-b55e3f2c-b09a-4144-9d63-dc5c694e3559 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/fc03fb3a-ef74-4844-8b89-48f2ca84967d" status: 200 len: 287 microversion: 2.1 time: 0.035148 May 23 16:56:28.079182 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 465/906] 10.222.0.74 () {58 vars in 1250 bytes} [Mon May 23 16:56:28 2022] GET /compute/v2.1/os-snapshots/fc03fb3a-ef74-4844-8b89-48f2ca84967d => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:56:29.092274 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-0c72b96a-9b53-4447-bcb4-5d8a8048ecc7 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Calling method '.version_select at 0x7f224c67a670>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:29.119404 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-0c72b96a-9b53-4447-bcb4-5d8a8048ecc7 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] HTTP exception thrown: Snapshot fc03fb3a-ef74-4844-8b89-48f2ca84967d could not be found. May 23 16:56:29.121796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-0c72b96a-9b53-4447-bcb4-5d8a8048ecc7 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Request method failure captured: May 23 16:56:29.121796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: GET /compute/v2.1/os-snapshots/fc03fb3a-ef74-4844-8b89-48f2ca84967d HTTP/1.1 May 23 16:56:29.121796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:56:29.121796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:56:29.121796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:56:29.121796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 16:56:29.121796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:56:29.121796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:56:29.121796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:56:29.121796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:56:29.121796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7y15hlC8OJ2YF1T13592V86kmwq11wmoZ0QttF_0YPvTHqrBkchhRT7Lkbx8MM3UIVfAopLvcmYs5PwugLrkMATrIWHGXvHEcrD0ZxKm3xrbejNcQcBPaCL5nBTJIIhPJSqGmCFz5WaAatfwEsGcgVRmA3hs5RKpMekh_-47FPZOeo May 23 16:56:29.121796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:56:29.121796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:56:29.121796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:56:29.121796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:56:29.121796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:56:29.121796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:56:29.121796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: f31f732170f54620aaec290a37a6d829 May 23 16:56:29.121796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-657522257 May 23 16:56:29.121796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:56:29.121796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:56:29.123450 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/f31f732170f54620aaec290a37a6d829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f31f732170f54620aaec290a37a6d829"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f31f732170f54620aaec290a37a6d829"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_f31f732170f54620aaec290a37a6d829"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:56:29.123450 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-VolumesSnapshotsTestJSON-657522257 May 23 16:56:29.123450 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: f31f732170f54620aaec290a37a6d829 May 23 16:56:29.123450 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-657522257 May 23 16:56:29.123450 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-VolumesSnapshotsTestJSON-657522257-project May 23 16:56:29.123450 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:56:29.123450 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:56:29.123450 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: f8c8686de96e4247a8c7eaded489b54f May 23 16:56:29.123450 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-VolumesSnapshotsTestJSON-657522257-project May 23 16:56:29.123450 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: May 23 16:56:29.123450 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Snapshot fc03fb3a-ef74-4844-8b89-48f2ca84967d could not be found. May 23 16:56:29.123450 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': 'fc03fb3a-ef74-4844-8b89-48f2ca84967d'} May 23 16:56:29.123450 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:56:29.124495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:29.124495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 23 16:56:29.124495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 23 16:56:29.124495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 23 16:56:29.124495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 23 16:56:29.124495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 23 16:56:29.124495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 23 16:56:29.124495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 16:56:29.124495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 16:56:29.124495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 16:56:29.124495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 16:56:29.124495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 16:56:29.124495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 16:56:29.124495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 16:56:29.124495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 16:56:29.124495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fc03fb3a-ef74-4844-8b89-48f2ca84967d could not be found. (HTTP 404) (Request-ID: req-5d049480-992e-4783-93a1-bbe492c7920d) May 23 16:56:29.124495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:29.124495 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:29.125838 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:29.125838 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:29.125838 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 23 16:56:29.125838 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 23 16:56:29.125838 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 16:56:29.125838 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 16:56:29.125838 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 23 16:56:29.125838 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 23 16:56:29.125838 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 16:56:29.125838 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 16:56:29.125838 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 23 16:56:29.125838 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 23 16:56:29.125838 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 23 16:56:29.125838 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 23 16:56:29.125838 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 23 16:56:29.125838 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 23 16:56:29.125838 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 16:56:29.125838 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 16:56:29.125838 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 16:56:29.127314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 16:56:29.127314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 16:56:29.127314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 16:56:29.127314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 16:56:29.127314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 16:56:29.127314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fc03fb3a-ef74-4844-8b89-48f2ca84967d could not be found. May 23 16:56:29.127314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:29.127314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:29.127314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:29.127314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:29.127314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:29.127314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:29.127314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:56:29.127314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:56:29.127314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 16:56:29.127314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 16:56:29.127314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:56:29.127314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:56:29.127314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 23 16:56:29.127314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:56:29.128979 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fc03fb3a-ef74-4844-8b89-48f2ca84967d could not be found. May 23 16:56:29.128979 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:29.128979 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:29.128979 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:29.128979 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:29.128979 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:29.128979 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:29.128979 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:56:29.128979 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:56:29.128979 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fc03fb3a-ef74-4844-8b89-48f2ca84967d could not be found. May 23 16:56:29.128979 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:29.128979 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-0c72b96a-9b53-4447-bcb4-5d8a8048ecc7 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Returning 404 to user: Snapshot fc03fb3a-ef74-4844-8b89-48f2ca84967d could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:56:29.128979 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-0c72b96a-9b53-4447-bcb4-5d8a8048ecc7 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/fc03fb3a-ef74-4844-8b89-48f2ca84967d" status: 404 len: 111 microversion: 2.1 time: 0.035960 May 23 16:56:29.128979 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 442/907] 10.222.0.74 () {58 vars in 1250 bytes} [Mon May 23 16:56:29 2022] GET /compute/v2.1/os-snapshots/fc03fb3a-ef74-4844-8b89-48f2ca84967d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:56:29.135642 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-626f2308-4a4e-42b8-970b-486ed5b6dd87 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Calling method '.version_select at 0x7f224c3964c0>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:29.493582 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-626f2308-4a4e-42b8-970b-486ed5b6dd87 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/683cfc9e-5f15-4bf0-857f-f32a73567b48" status: 202 len: 0 microversion: 2.1 time: 0.362114 May 23 16:56:29.498641 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 466/908] 10.222.0.74 () {58 vars in 1247 bytes} [Mon May 23 16:56:29 2022] DELETE /compute/v2.1/os-volumes/683cfc9e-5f15-4bf0-857f-f32a73567b48 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:56:29.506727 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-f66b4c94-a984-4fa3-b72c-93f7b128ad8d tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Calling method '.version_select at 0x7f224c2e7ca0>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:29.554980 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-f66b4c94-a984-4fa3-b72c-93f7b128ad8d tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/683cfc9e-5f15-4bf0-857f-f32a73567b48" status: 200 len: 344 microversion: 2.1 time: 0.053465 May 23 16:56:29.561687 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 443/909] 10.222.0.74 () {58 vars in 1244 bytes} [Mon May 23 16:56:29 2022] GET /compute/v2.1/os-volumes/683cfc9e-5f15-4bf0-857f-f32a73567b48 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:56:30.567560 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c36e988f-532f-43fc-91cf-38d0ea1be604 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Calling method '.version_select at 0x7f224d0a4d30>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:30.594529 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-c36e988f-532f-43fc-91cf-38d0ea1be604 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] HTTP exception thrown: Volume 683cfc9e-5f15-4bf0-857f-f32a73567b48 could not be found. May 23 16:56:30.596538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c36e988f-532f-43fc-91cf-38d0ea1be604 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Request method failure captured: May 23 16:56:30.596538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: GET /compute/v2.1/os-volumes/683cfc9e-5f15-4bf0-857f-f32a73567b48 HTTP/1.1 May 23 16:56:30.596538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:56:30.596538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:56:30.596538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:56:30.596538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:56:30.596538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:56:30.596538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:56:30.596538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:56:30.596538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:56:30.596538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7y15hlC8OJ2YF1T13592V86kmwq11wmoZ0QttF_0YPvTHqrBkchhRT7Lkbx8MM3UIVfAopLvcmYs5PwugLrkMATrIWHGXvHEcrD0ZxKm3xrbejNcQcBPaCL5nBTJIIhPJSqGmCFz5WaAatfwEsGcgVRmA3hs5RKpMekh_-47FPZOeo May 23 16:56:30.596538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:56:30.596538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:56:30.596538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:56:30.596538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:56:30.596538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:56:30.596538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:56:30.596538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: f31f732170f54620aaec290a37a6d829 May 23 16:56:30.596538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-657522257 May 23 16:56:30.596538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:56:30.596538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:56:30.598746 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/f31f732170f54620aaec290a37a6d829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f31f732170f54620aaec290a37a6d829"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f31f732170f54620aaec290a37a6d829"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_f31f732170f54620aaec290a37a6d829"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:56:30.598746 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-VolumesSnapshotsTestJSON-657522257 May 23 16:56:30.598746 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: f31f732170f54620aaec290a37a6d829 May 23 16:56:30.598746 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-657522257 May 23 16:56:30.598746 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-VolumesSnapshotsTestJSON-657522257-project May 23 16:56:30.598746 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:56:30.598746 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:56:30.598746 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: f8c8686de96e4247a8c7eaded489b54f May 23 16:56:30.598746 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-VolumesSnapshotsTestJSON-657522257-project May 23 16:56:30.598746 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: May 23 16:56:30.598746 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Volume 683cfc9e-5f15-4bf0-857f-f32a73567b48 could not be found. May 23 16:56:30.598746 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': '683cfc9e-5f15-4bf0-857f-f32a73567b48'} May 23 16:56:30.598746 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:56:30.599863 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:30.599863 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 16:56:30.599863 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 16:56:30.599863 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 16:56:30.599863 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 16:56:30.599863 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 16:56:30.599863 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 16:56:30.599863 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 16:56:30.599863 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 16:56:30.599863 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 16:56:30.599863 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 16:56:30.599863 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 16:56:30.599863 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 16:56:30.599863 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 16:56:30.599863 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 16:56:30.599863 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 683cfc9e-5f15-4bf0-857f-f32a73567b48 could not be found. (HTTP 404) (Request-ID: req-3c384578-ac1c-43ef-b85b-a5a6d7983dd1) May 23 16:56:30.599863 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:30.599863 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:30.599863 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:30.601448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:30.601448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 16:56:30.601448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 16:56:30.601448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 16:56:30.601448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 16:56:30.601448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 16:56:30.601448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 16:56:30.601448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 16:56:30.601448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 16:56:30.601448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 16:56:30.601448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 16:56:30.601448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 16:56:30.601448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 16:56:30.601448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 16:56:30.601448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 16:56:30.601448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 16:56:30.601448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 16:56:30.601448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 16:56:30.601448 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 16:56:30.602871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 16:56:30.602871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 16:56:30.602871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 16:56:30.602871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 16:56:30.602871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 683cfc9e-5f15-4bf0-857f-f32a73567b48 could not be found. May 23 16:56:30.602871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:30.602871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:30.602871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:30.602871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:30.602871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:30.602871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:30.602871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:56:30.602871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:56:30.602871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 16:56:30.602871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 16:56:30.602871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:56:30.602871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:56:30.602871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 16:56:30.602871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:56:30.604422 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 683cfc9e-5f15-4bf0-857f-f32a73567b48 could not be found. May 23 16:56:30.604422 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:30.604422 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:30.604422 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:30.604422 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:30.604422 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:30.604422 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:30.604422 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:56:30.604422 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:56:30.604422 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 683cfc9e-5f15-4bf0-857f-f32a73567b48 could not be found. May 23 16:56:30.604422 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:30.604422 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c36e988f-532f-43fc-91cf-38d0ea1be604 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Returning 404 to user: Volume 683cfc9e-5f15-4bf0-857f-f32a73567b48 could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:56:30.604422 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-c36e988f-532f-43fc-91cf-38d0ea1be604 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/683cfc9e-5f15-4bf0-857f-f32a73567b48" status: 404 len: 109 microversion: 2.1 time: 0.034900 May 23 16:56:30.604422 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 467/910] 10.222.0.74 () {58 vars in 1244 bytes} [Mon May 23 16:56:30 2022] GET /compute/v2.1/os-volumes/683cfc9e-5f15-4bf0-857f-f32a73567b48 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:56:30.609399 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-104fe3de-319b-42df-9f8e-ee807db3a888 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Calling method '.version_select at 0x7f224c291d30>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:30.637918 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-104fe3de-319b-42df-9f8e-ee807db3a888 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] HTTP exception thrown: Volume 683cfc9e-5f15-4bf0-857f-f32a73567b48 could not be found. May 23 16:56:30.640058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-104fe3de-319b-42df-9f8e-ee807db3a888 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Request method failure captured: May 23 16:56:30.640058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: DELETE /compute/v2.1/os-volumes/683cfc9e-5f15-4bf0-857f-f32a73567b48 HTTP/1.1 May 23 16:56:30.640058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:56:30.640058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:56:30.640058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:56:30.640058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 16:56:30.640058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:56:30.640058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:56:30.640058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:56:30.640058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:56:30.640058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7y15hlC8OJ2YF1T13592V86kmwq11wmoZ0QttF_0YPvTHqrBkchhRT7Lkbx8MM3UIVfAopLvcmYs5PwugLrkMATrIWHGXvHEcrD0ZxKm3xrbejNcQcBPaCL5nBTJIIhPJSqGmCFz5WaAatfwEsGcgVRmA3hs5RKpMekh_-47FPZOeo May 23 16:56:30.640058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:56:30.640058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:56:30.640058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:56:30.640058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:56:30.640058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:56:30.640058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:56:30.640058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: f31f732170f54620aaec290a37a6d829 May 23 16:56:30.640058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-657522257 May 23 16:56:30.640058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:56:30.640058 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:56:30.641789 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/f31f732170f54620aaec290a37a6d829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f31f732170f54620aaec290a37a6d829"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f31f732170f54620aaec290a37a6d829"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_f31f732170f54620aaec290a37a6d829"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:56:30.641789 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-VolumesSnapshotsTestJSON-657522257 May 23 16:56:30.641789 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: f31f732170f54620aaec290a37a6d829 May 23 16:56:30.641789 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-657522257 May 23 16:56:30.641789 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-VolumesSnapshotsTestJSON-657522257-project May 23 16:56:30.641789 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:56:30.641789 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:56:30.641789 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: f8c8686de96e4247a8c7eaded489b54f May 23 16:56:30.641789 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-VolumesSnapshotsTestJSON-657522257-project May 23 16:56:30.641789 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: May 23 16:56:30.641789 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Volume 683cfc9e-5f15-4bf0-857f-f32a73567b48 could not be found. May 23 16:56:30.641789 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': '683cfc9e-5f15-4bf0-857f-f32a73567b48'} May 23 16:56:30.641789 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:56:30.642766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:30.642766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 16:56:30.642766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 16:56:30.642766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 16:56:30.642766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 16:56:30.642766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 16:56:30.642766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 16:56:30.642766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 16:56:30.642766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 16:56:30.642766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 16:56:30.642766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 16:56:30.642766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 16:56:30.642766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 16:56:30.642766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 16:56:30.642766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 16:56:30.642766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 683cfc9e-5f15-4bf0-857f-f32a73567b48 could not be found. (HTTP 404) (Request-ID: req-914a9240-65ff-4eb0-a543-fbcf34f19383) May 23 16:56:30.642766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:30.642766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:30.642766 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:30.644267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:30.644267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 16:56:30.644267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 16:56:30.644267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 16:56:30.644267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 16:56:30.644267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 16:56:30.644267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 16:56:30.644267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 16:56:30.644267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 16:56:30.644267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 16:56:30.644267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 16:56:30.644267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 16:56:30.644267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 16:56:30.644267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 16:56:30.644267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 16:56:30.644267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 16:56:30.644267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 16:56:30.644267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 16:56:30.644267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 16:56:30.646118 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 16:56:30.646118 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 16:56:30.646118 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 16:56:30.646118 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 16:56:30.646118 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 683cfc9e-5f15-4bf0-857f-f32a73567b48 could not be found. May 23 16:56:30.646118 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:30.646118 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:30.646118 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:30.646118 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:30.646118 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:30.646118 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:30.646118 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:56:30.646118 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:56:30.646118 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 16:56:30.646118 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 16:56:30.646118 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:56:30.646118 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:56:30.646118 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 16:56:30.646118 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:56:30.647607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 683cfc9e-5f15-4bf0-857f-f32a73567b48 could not be found. May 23 16:56:30.647607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:30.647607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:30.647607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:30.647607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:30.647607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:30.647607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:30.647607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:56:30.647607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:56:30.647607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 683cfc9e-5f15-4bf0-857f-f32a73567b48 could not be found. May 23 16:56:30.647607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:30.647607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-104fe3de-319b-42df-9f8e-ee807db3a888 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Returning 404 to user: Volume 683cfc9e-5f15-4bf0-857f-f32a73567b48 could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:56:30.647607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-104fe3de-319b-42df-9f8e-ee807db3a888 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/683cfc9e-5f15-4bf0-857f-f32a73567b48" status: 404 len: 109 microversion: 2.1 time: 0.036609 May 23 16:56:30.647607 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 444/911] 10.222.0.74 () {58 vars in 1247 bytes} [Mon May 23 16:56:30 2022] DELETE /compute/v2.1/os-volumes/683cfc9e-5f15-4bf0-857f-f32a73567b48 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:56:30.651947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-1fb55aee-b00e-4cc9-b70e-d06e2da02272 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Calling method '.version_select at 0x7f224c551af0>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:30.684466 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-1fb55aee-b00e-4cc9-b70e-d06e2da02272 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] HTTP exception thrown: Volume 683cfc9e-5f15-4bf0-857f-f32a73567b48 could not be found. May 23 16:56:30.687405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-1fb55aee-b00e-4cc9-b70e-d06e2da02272 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Request method failure captured: May 23 16:56:30.687405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: GET /compute/v2.1/os-volumes/683cfc9e-5f15-4bf0-857f-f32a73567b48 HTTP/1.1 May 23 16:56:30.687405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:56:30.687405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:56:30.687405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:56:30.687405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:56:30.687405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:56:30.687405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:56:30.687405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:56:30.687405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:56:30.687405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7y15hlC8OJ2YF1T13592V86kmwq11wmoZ0QttF_0YPvTHqrBkchhRT7Lkbx8MM3UIVfAopLvcmYs5PwugLrkMATrIWHGXvHEcrD0ZxKm3xrbejNcQcBPaCL5nBTJIIhPJSqGmCFz5WaAatfwEsGcgVRmA3hs5RKpMekh_-47FPZOeo May 23 16:56:30.687405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:56:30.687405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:56:30.687405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:56:30.687405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:56:30.687405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:56:30.687405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:56:30.687405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: f31f732170f54620aaec290a37a6d829 May 23 16:56:30.687405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-657522257 May 23 16:56:30.687405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:56:30.687405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:56:30.689117 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/f31f732170f54620aaec290a37a6d829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f31f732170f54620aaec290a37a6d829"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f31f732170f54620aaec290a37a6d829"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_f31f732170f54620aaec290a37a6d829"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:56:30.689117 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-VolumesSnapshotsTestJSON-657522257 May 23 16:56:30.689117 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: f31f732170f54620aaec290a37a6d829 May 23 16:56:30.689117 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-657522257 May 23 16:56:30.689117 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-VolumesSnapshotsTestJSON-657522257-project May 23 16:56:30.689117 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:56:30.689117 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:56:30.689117 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: f8c8686de96e4247a8c7eaded489b54f May 23 16:56:30.689117 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-VolumesSnapshotsTestJSON-657522257-project May 23 16:56:30.689117 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: May 23 16:56:30.689117 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Volume 683cfc9e-5f15-4bf0-857f-f32a73567b48 could not be found. May 23 16:56:30.689117 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': '683cfc9e-5f15-4bf0-857f-f32a73567b48'} May 23 16:56:30.689117 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:56:30.690709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:30.690709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 16:56:30.690709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 16:56:30.690709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 16:56:30.690709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 16:56:30.690709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 16:56:30.690709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 16:56:30.690709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 16:56:30.690709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 16:56:30.690709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 16:56:30.690709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 16:56:30.690709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 16:56:30.690709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 16:56:30.690709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 16:56:30.690709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 16:56:30.690709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 683cfc9e-5f15-4bf0-857f-f32a73567b48 could not be found. (HTTP 404) (Request-ID: req-d9d15d8c-8321-4041-a371-b7ee134dfc43) May 23 16:56:30.690709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:30.690709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:30.690709 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:30.692592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:30.692592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 16:56:30.692592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 16:56:30.692592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 16:56:30.692592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 16:56:30.692592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 16:56:30.692592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 16:56:30.692592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 16:56:30.692592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 16:56:30.692592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 16:56:30.692592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 16:56:30.692592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 16:56:30.692592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 16:56:30.692592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 16:56:30.692592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 16:56:30.692592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 16:56:30.692592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 16:56:30.692592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 16:56:30.692592 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 16:56:30.694304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 16:56:30.694304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 16:56:30.694304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 16:56:30.694304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 16:56:30.694304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 683cfc9e-5f15-4bf0-857f-f32a73567b48 could not be found. May 23 16:56:30.694304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:30.694304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:30.694304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:30.694304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:30.694304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:30.694304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:30.694304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:56:30.694304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:56:30.694304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 16:56:30.694304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 16:56:30.694304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:56:30.694304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:56:30.694304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 16:56:30.694304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:56:30.696252 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 683cfc9e-5f15-4bf0-857f-f32a73567b48 could not be found. May 23 16:56:30.696252 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:30.696252 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:30.696252 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:30.696252 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:30.696252 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:30.696252 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:30.696252 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:56:30.696252 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:56:30.696252 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 683cfc9e-5f15-4bf0-857f-f32a73567b48 could not be found. May 23 16:56:30.696252 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:56:30.696252 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-1fb55aee-b00e-4cc9-b70e-d06e2da02272 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] Returning 404 to user: Volume 683cfc9e-5f15-4bf0-857f-f32a73567b48 could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:56:30.696252 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-1fb55aee-b00e-4cc9-b70e-d06e2da02272 tempest-VolumesSnapshotsTestJSON-657522257 tempest-VolumesSnapshotsTestJSON-657522257-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/683cfc9e-5f15-4bf0-857f-f32a73567b48" status: 404 len: 109 microversion: 2.1 time: 0.041837 May 23 16:56:30.696252 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 468/912] 10.222.0.74 () {58 vars in 1244 bytes} [Mon May 23 16:56:30 2022] GET /compute/v2.1/os-volumes/683cfc9e-5f15-4bf0-857f-f32a73567b48 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:56:33.057195 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-e59ef2dc-ce47-4345-83bc-d80d1b0c7dad tempest-VolumesGetTestJSON-2089930106 tempest-VolumesGetTestJSON-2089930106-project] Action: 'create', calling method: .version_select at 0x7f224c291160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-386753966", "metadata": {"Type": "work"}}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:56:33.684570 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-e59ef2dc-ce47-4345-83bc-d80d1b0c7dad tempest-VolumesGetTestJSON-2089930106 tempest-VolumesGetTestJSON-2089930106-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.748978 May 23 16:56:33.685150 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 445/913] 10.222.0.74 () {60 vars in 1155 bytes} [Mon May 23 16:56:32 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 750 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 23 16:56:33.696848 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-09a58c01-8f07-4484-973f-cc3ecd0c11eb tempest-VolumesGetTestJSON-2089930106 tempest-VolumesGetTestJSON-2089930106-project] Calling method '.version_select at 0x7f224c4a6280>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:33.744309 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-09a58c01-8f07-4484-973f-cc3ecd0c11eb tempest-VolumesGetTestJSON-2089930106 tempest-VolumesGetTestJSON-2089930106-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/2c96da52-edaf-4366-871e-adc47b46b07c" status: 200 len: 352 microversion: 2.1 time: 0.051788 May 23 16:56:33.744909 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 469/914] 10.222.0.74 () {58 vars in 1244 bytes} [Mon May 23 16:56:33 2022] GET /compute/v2.1/os-volumes/2c96da52-edaf-4366-871e-adc47b46b07c => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:56:34.757658 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-fa78d03a-cf4c-412a-9be9-9db721d231e1 tempest-VolumesGetTestJSON-2089930106 tempest-VolumesGetTestJSON-2089930106-project] Calling method '.version_select at 0x7f224c2e7ca0>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:34.804901 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-fa78d03a-cf4c-412a-9be9-9db721d231e1 tempest-VolumesGetTestJSON-2089930106 tempest-VolumesGetTestJSON-2089930106-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/2c96da52-edaf-4366-871e-adc47b46b07c" status: 200 len: 353 microversion: 2.1 time: 0.051816 May 23 16:56:34.805467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 446/915] 10.222.0.74 () {58 vars in 1244 bytes} [Mon May 23 16:56:34 2022] GET /compute/v2.1/os-volumes/2c96da52-edaf-4366-871e-adc47b46b07c => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:56:34.817483 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-8deb0e03-7ff9-4064-9381-3044c19370f3 tempest-VolumesGetTestJSON-2089930106 tempest-VolumesGetTestJSON-2089930106-project] Calling method '.version_select at 0x7f224c52d5e0>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:34.865365 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-8deb0e03-7ff9-4064-9381-3044c19370f3 tempest-VolumesGetTestJSON-2089930106 tempest-VolumesGetTestJSON-2089930106-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/2c96da52-edaf-4366-871e-adc47b46b07c" status: 200 len: 353 microversion: 2.1 time: 0.052158 May 23 16:56:34.865921 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 470/916] 10.222.0.74 () {58 vars in 1244 bytes} [Mon May 23 16:56:34 2022] GET /compute/v2.1/os-volumes/2c96da52-edaf-4366-871e-adc47b46b07c => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:56:34.881756 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-048772da-3ef5-49af-9511-acfd58855c69 tempest-VolumesGetTestJSON-2089930106 tempest-VolumesGetTestJSON-2089930106-project] Calling method '.version_select at 0x7f224c633550>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:35.069986 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-048772da-3ef5-49af-9511-acfd58855c69 tempest-VolumesGetTestJSON-2089930106 tempest-VolumesGetTestJSON-2089930106-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/2c96da52-edaf-4366-871e-adc47b46b07c" status: 202 len: 0 microversion: 2.1 time: 0.192047 May 23 16:56:35.070647 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 447/917] 10.222.0.74 () {58 vars in 1247 bytes} [Mon May 23 16:56:34 2022] DELETE /compute/v2.1/os-volumes/2c96da52-edaf-4366-871e-adc47b46b07c => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:56:35.078526 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-37a01940-3e57-4675-8485-9768e2e87981 tempest-VolumesGetTestJSON-2089930106 tempest-VolumesGetTestJSON-2089930106-project] Calling method '.version_select at 0x7f224c36b0d0>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:35.132811 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-37a01940-3e57-4675-8485-9768e2e87981 tempest-VolumesGetTestJSON-2089930106 tempest-VolumesGetTestJSON-2089930106-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/2c96da52-edaf-4366-871e-adc47b46b07c" status: 200 len: 352 microversion: 2.1 time: 0.052292 May 23 16:56:35.132811 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 471/918] 10.222.0.74 () {58 vars in 1244 bytes} [Mon May 23 16:56:35 2022] GET /compute/v2.1/os-volumes/2c96da52-edaf-4366-871e-adc47b46b07c => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:56:35.216798 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-090e2a17-f43b-48f9-825d-ddcfcaff6e45 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1905254566", "imageRef": "96972e76-879d-4149-a713-a94529892aad", "flavorRef": "452", "networks": [{"uuid": "27e901e8-80f2-4802-ac5f-dae1e13097cd"}]}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:56:35.272731 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.network.neutron [None req-090e2a17-f43b-48f9-825d-ddcfcaff6e45 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] validate_networks() for [('27e901e8-80f2-4802-ac5f-dae1e13097cd', None, None, None, None, None)] {{(pid=124714) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 16:56:35.635135 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-090e2a17-f43b-48f9-825d-ddcfcaff6e45 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Flavor limits 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 16:56:35.635557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-090e2a17-f43b-48f9-825d-ddcfcaff6e45 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Image limits 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 16:56:35.636030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-090e2a17-f43b-48f9-825d-ddcfcaff6e45 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Flavor pref 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 16:56:35.636469 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-090e2a17-f43b-48f9-825d-ddcfcaff6e45 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Image pref 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 16:56:35.636882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-090e2a17-f43b-48f9-825d-ddcfcaff6e45 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 16:56:35.645739 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-090e2a17-f43b-48f9-825d-ddcfcaff6e45 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:35.646666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-090e2a17-f43b-48f9-825d-ddcfcaff6e45 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:35.647081 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-090e2a17-f43b-48f9-825d-ddcfcaff6e45 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:35.647508 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-090e2a17-f43b-48f9-825d-ddcfcaff6e45 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:35.663982 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-090e2a17-f43b-48f9-825d-ddcfcaff6e45 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Getting quotas for project 8accbe2ccd0d415fa3f31e3b0f6298db. Resources: {'cores', 'instances', 'ram'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:56:35.667902 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-090e2a17-f43b-48f9-825d-ddcfcaff6e45 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Getting quotas for user b78d8e7ea1c24cc5ba664b410e7ed39a and project 8accbe2ccd0d415fa3f31e3b0f6298db. Resources: {'cores', 'instances', 'ram'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:56:35.679817 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-090e2a17-f43b-48f9-825d-ddcfcaff6e45 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Going to run 1 instances... {{(pid=124714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 16:56:35.682187 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-090e2a17-f43b-48f9-825d-ddcfcaff6e45 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: 081a9417-6f3a-436d-85ec-52ff0846efb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96972e76-879d-4149-a713-a94529892aad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 16:56:35.820785 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-090e2a17-f43b-48f9-825d-ddcfcaff6e45 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607688 May 23 16:56:35.822280 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 448/919] 10.222.0.74 () {60 vars in 1146 bytes} [Mon May 23 16:56:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 16:56:35.832117 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-14a1dfb9-5135-49f8-b2b0-197fac0f195b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:35.833028 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-14a1dfb9-5135-49f8-b2b0-197fac0f195b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: 081a9417-6f3a-436d-85ec-52ff0846efb6] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:35.886611 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-14a1dfb9-5135-49f8-b2b0-197fac0f195b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:35.893736 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-14a1dfb9-5135-49f8-b2b0-197fac0f195b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6" status: 200 len: 1214 microversion: 2.1 time: 0.066119 May 23 16:56:35.894294 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 472/920] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:35 2022] GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:56:36.139786 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-2bbb66ed-fdac-47c2-a060-a392630d23a1 tempest-VolumesGetTestJSON-2089930106 tempest-VolumesGetTestJSON-2089930106-project] Calling method '.version_select at 0x7f224c7aa430>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:36.168949 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-2bbb66ed-fdac-47c2-a060-a392630d23a1 tempest-VolumesGetTestJSON-2089930106 tempest-VolumesGetTestJSON-2089930106-project] HTTP exception thrown: Volume 2c96da52-edaf-4366-871e-adc47b46b07c could not be found. May 23 16:56:36.170999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-2bbb66ed-fdac-47c2-a060-a392630d23a1 tempest-VolumesGetTestJSON-2089930106 tempest-VolumesGetTestJSON-2089930106-project] Request method failure captured: May 23 16:56:36.170999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: GET /compute/v2.1/os-volumes/2c96da52-edaf-4366-871e-adc47b46b07c HTTP/1.1 May 23 16:56:36.170999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:56:36.170999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:56:36.170999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:56:36.170999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 16:56:36.170999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:56:36.170999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:56:36.170999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:56:36.170999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:56:36.170999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7zAOF0QQ4ft8sSfoFuJo_zuXXlxvCvGWLWdQsJKAvbj9fg7ZImL6kwBi0WFb7FUVsEnaFRxmv-X6e2mFMdrWK3a-kwku85jdTRGgODA2ov3t_j9GVFYuFsi7FL0VfCCRePfP_9ak0WQets0ziOE9c7OtSEL2pAoAnMAhS13IcBrkfI May 23 16:56:36.170999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:56:36.170999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:56:36.170999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:56:36.170999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:56:36.170999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:56:36.170999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:56:36.170999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: 96967c2d1cf04127ad38fd6f79427479 May 23 16:56:36.170999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-VolumesGetTestJSON-2089930106 May 23 16:56:36.170999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:56:36.170999 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:56:36.172662 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/96967c2d1cf04127ad38fd6f79427479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/96967c2d1cf04127ad38fd6f79427479"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/96967c2d1cf04127ad38fd6f79427479"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_96967c2d1cf04127ad38fd6f79427479"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:56:36.172662 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-VolumesGetTestJSON-2089930106 May 23 16:56:36.172662 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: 96967c2d1cf04127ad38fd6f79427479 May 23 16:56:36.172662 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-VolumesGetTestJSON-2089930106 May 23 16:56:36.172662 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-VolumesGetTestJSON-2089930106-project May 23 16:56:36.172662 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:56:36.172662 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:56:36.172662 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 3b424f2f8dfa401a895bcb294aca072e May 23 16:56:36.172662 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-VolumesGetTestJSON-2089930106-project May 23 16:56:36.172662 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: May 23 16:56:36.172662 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Volume 2c96da52-edaf-4366-871e-adc47b46b07c could not be found. May 23 16:56:36.172662 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': '2c96da52-edaf-4366-871e-adc47b46b07c'} May 23 16:56:36.172662 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:56:36.173772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:36.173772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 16:56:36.173772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 16:56:36.173772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 16:56:36.173772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 16:56:36.173772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 16:56:36.173772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 16:56:36.173772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 16:56:36.173772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 16:56:36.173772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 16:56:36.173772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 16:56:36.173772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 16:56:36.173772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 16:56:36.173772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 16:56:36.173772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 16:56:36.173772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c96da52-edaf-4366-871e-adc47b46b07c could not be found. (HTTP 404) (Request-ID: req-ec33cac0-2854-49ad-b610-9d90acef702c) May 23 16:56:36.173772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:36.173772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:36.173772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:36.175056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:36.175056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 16:56:36.175056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 16:56:36.175056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 16:56:36.175056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 16:56:36.175056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 16:56:36.175056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 16:56:36.175056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 16:56:36.175056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 16:56:36.175056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 16:56:36.175056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 16:56:36.175056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 16:56:36.175056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 16:56:36.175056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 16:56:36.175056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 16:56:36.175056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 16:56:36.175056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 16:56:36.175056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 16:56:36.175056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 16:56:36.185937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 16:56:36.185937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 16:56:36.185937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 16:56:36.185937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 16:56:36.185937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c96da52-edaf-4366-871e-adc47b46b07c could not be found. May 23 16:56:36.185937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:36.185937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:36.185937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:36.185937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:36.185937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:36.185937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:36.185937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:56:36.185937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:56:36.185937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 16:56:36.185937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 16:56:36.185937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:56:36.185937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:56:36.185937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 16:56:36.185937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:56:36.188193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c96da52-edaf-4366-871e-adc47b46b07c could not be found. May 23 16:56:36.188193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:36.188193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:36.188193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:36.188193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:36.188193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:36.188193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:36.188193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:56:36.188193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:56:36.188193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c96da52-edaf-4366-871e-adc47b46b07c could not be found. May 23 16:56:36.188193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:36.188193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-2bbb66ed-fdac-47c2-a060-a392630d23a1 tempest-VolumesGetTestJSON-2089930106 tempest-VolumesGetTestJSON-2089930106-project] Returning 404 to user: Volume 2c96da52-edaf-4366-871e-adc47b46b07c could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:56:36.188193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-2bbb66ed-fdac-47c2-a060-a392630d23a1 tempest-VolumesGetTestJSON-2089930106 tempest-VolumesGetTestJSON-2089930106-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/2c96da52-edaf-4366-871e-adc47b46b07c" status: 404 len: 109 microversion: 2.1 time: 0.036764 May 23 16:56:36.188193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 449/921] 10.222.0.74 () {58 vars in 1244 bytes} [Mon May 23 16:56:36 2022] GET /compute/v2.1/os-volumes/2c96da52-edaf-4366-871e-adc47b46b07c => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:56:36.917001 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-b23ad09d-a56e-4826-908c-0a65b7b94a51 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:36.919397 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-b23ad09d-a56e-4826-908c-0a65b7b94a51 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: 081a9417-6f3a-436d-85ec-52ff0846efb6] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:36.930219 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b23ad09d-a56e-4826-908c-0a65b7b94a51 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:36.931123 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b23ad09d-a56e-4826-908c-0a65b7b94a51 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:36.935895 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b23ad09d-a56e-4826-908c-0a65b7b94a51 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:36.935895 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b23ad09d-a56e-4826-908c-0a65b7b94a51 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:37.002495 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-b23ad09d-a56e-4826-908c-0a65b7b94a51 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:37.010681 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-b23ad09d-a56e-4826-908c-0a65b7b94a51 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6" status: 200 len: 1218 microversion: 2.1 time: 0.102449 May 23 16:56:37.011251 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 473/922] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:36 2022] GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:56:38.031315 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-77d7b898-02bc-4cf0-a51e-b0c46f6f292f tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:38.033415 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-77d7b898-02bc-4cf0-a51e-b0c46f6f292f tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: 081a9417-6f3a-436d-85ec-52ff0846efb6] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:38.044116 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-77d7b898-02bc-4cf0-a51e-b0c46f6f292f tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:38.044967 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-77d7b898-02bc-4cf0-a51e-b0c46f6f292f tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:38.048061 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-77d7b898-02bc-4cf0-a51e-b0c46f6f292f tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:38.048841 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-77d7b898-02bc-4cf0-a51e-b0c46f6f292f tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:38.134367 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-77d7b898-02bc-4cf0-a51e-b0c46f6f292f tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:38.142057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-77d7b898-02bc-4cf0-a51e-b0c46f6f292f tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6" status: 200 len: 1284 microversion: 2.1 time: 0.118133 May 23 16:56:38.142591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 450/923] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:38 2022] GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6 => generated 1284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:56:39.159791 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e3593a7c-8626-411e-b7bb-c05b47ba86bc tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:39.160473 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e3593a7c-8626-411e-b7bb-c05b47ba86bc tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: 081a9417-6f3a-436d-85ec-52ff0846efb6] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:39.167878 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e3593a7c-8626-411e-b7bb-c05b47ba86bc tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:39.173481 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e3593a7c-8626-411e-b7bb-c05b47ba86bc tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:39.173481 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e3593a7c-8626-411e-b7bb-c05b47ba86bc tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:39.173481 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e3593a7c-8626-411e-b7bb-c05b47ba86bc tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:39.415567 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e3593a7c-8626-411e-b7bb-c05b47ba86bc tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:39.423321 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e3593a7c-8626-411e-b7bb-c05b47ba86bc tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6" status: 200 len: 1314 microversion: 2.1 time: 0.267517 May 23 16:56:39.423900 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 474/924] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:39 2022] GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:56:39.782553 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-1dff3a59-aafc-4b5f-80d3-7502ff4a86ea req-791a67c4-324f-4239-83ab-73678f0852e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "081a9417-6f3a-436d-85ec-52ff0846efb6", "tag": "39215849-d947-4102-9719-0ea50d8320a5"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:56:39.791131 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-1dff3a59-aafc-4b5f-80d3-7502ff4a86ea req-791a67c4-324f-4239-83ab-73678f0852e0 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:39.796810 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-1dff3a59-aafc-4b5f-80d3-7502ff4a86ea req-791a67c4-324f-4239-83ab-73678f0852e0 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:39.803077 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-1dff3a59-aafc-4b5f-80d3-7502ff4a86ea req-791a67c4-324f-4239-83ab-73678f0852e0 service nova] Creating event network-changed:39215849-d947-4102-9719-0ea50d8320a5 for instance 081a9417-6f3a-436d-85ec-52ff0846efb6 on hv-cinder-83925 May 23 16:56:39.808773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-1dff3a59-aafc-4b5f-80d3-7502ff4a86ea req-791a67c4-324f-4239-83ab-73678f0852e0 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174921 May 23 16:56:39.809404 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 451/925] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:56:40.440524 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-647662ec-494e-41a6-b3e1-a7ea56820fce tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:40.441138 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-647662ec-494e-41a6-b3e1-a7ea56820fce tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: 081a9417-6f3a-436d-85ec-52ff0846efb6] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:40.447744 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-647662ec-494e-41a6-b3e1-a7ea56820fce tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:40.448193 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-647662ec-494e-41a6-b3e1-a7ea56820fce tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:40.448978 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-647662ec-494e-41a6-b3e1-a7ea56820fce tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:40.449417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-647662ec-494e-41a6-b3e1-a7ea56820fce tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:40.582550 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-647662ec-494e-41a6-b3e1-a7ea56820fce tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:40.589957 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-647662ec-494e-41a6-b3e1-a7ea56820fce tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6" status: 200 len: 1314 microversion: 2.1 time: 0.153330 May 23 16:56:40.590511 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 475/926] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:40 2022] GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:56:41.607713 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-75d17a15-e8f7-4905-994d-0f2730e1e207 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:41.608390 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-75d17a15-e8f7-4905-994d-0f2730e1e207 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: 081a9417-6f3a-436d-85ec-52ff0846efb6] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:41.615699 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-75d17a15-e8f7-4905-994d-0f2730e1e207 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:41.616259 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-75d17a15-e8f7-4905-994d-0f2730e1e207 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:41.617075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-75d17a15-e8f7-4905-994d-0f2730e1e207 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:41.617512 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-75d17a15-e8f7-4905-994d-0f2730e1e207 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:41.745193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-75d17a15-e8f7-4905-994d-0f2730e1e207 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:41.752568 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-75d17a15-e8f7-4905-994d-0f2730e1e207 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6" status: 200 len: 1314 microversion: 2.1 time: 0.149225 May 23 16:56:41.753164 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 452/927] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:41 2022] GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:56:42.769867 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-14311a72-e784-4d7d-b860-0b7aaaaac39b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:42.770490 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-14311a72-e784-4d7d-b860-0b7aaaaac39b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: 081a9417-6f3a-436d-85ec-52ff0846efb6] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:42.777795 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-14311a72-e784-4d7d-b860-0b7aaaaac39b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:42.778253 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-14311a72-e784-4d7d-b860-0b7aaaaac39b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:42.779187 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-14311a72-e784-4d7d-b860-0b7aaaaac39b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:42.779623 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-14311a72-e784-4d7d-b860-0b7aaaaac39b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:42.913173 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-14311a72-e784-4d7d-b860-0b7aaaaac39b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:42.920616 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-14311a72-e784-4d7d-b860-0b7aaaaac39b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6" status: 200 len: 1314 microversion: 2.1 time: 0.154583 May 23 16:56:42.921183 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 476/928] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:42 2022] GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:56:43.937940 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-49583b99-3e9f-41b4-80e2-c100c2a5038e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:43.938601 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-49583b99-3e9f-41b4-80e2-c100c2a5038e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: 081a9417-6f3a-436d-85ec-52ff0846efb6] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:43.945548 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-49583b99-3e9f-41b4-80e2-c100c2a5038e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:43.946003 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-49583b99-3e9f-41b4-80e2-c100c2a5038e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:43.946779 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-49583b99-3e9f-41b4-80e2-c100c2a5038e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:43.947225 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-49583b99-3e9f-41b4-80e2-c100c2a5038e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:44.078920 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-49583b99-3e9f-41b4-80e2-c100c2a5038e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:44.086970 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-49583b99-3e9f-41b4-80e2-c100c2a5038e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6" status: 200 len: 1314 microversion: 2.1 time: 0.152939 May 23 16:56:44.087919 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 453/929] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:43 2022] GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:56:45.104694 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-1662e6e9-6652-470f-bf07-c720f8b604a1 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:45.105364 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-1662e6e9-6652-470f-bf07-c720f8b604a1 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: 081a9417-6f3a-436d-85ec-52ff0846efb6] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:45.112054 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1662e6e9-6652-470f-bf07-c720f8b604a1 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:45.112597 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1662e6e9-6652-470f-bf07-c720f8b604a1 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:45.113432 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1662e6e9-6652-470f-bf07-c720f8b604a1 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:45.113986 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1662e6e9-6652-470f-bf07-c720f8b604a1 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:45.244230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-1662e6e9-6652-470f-bf07-c720f8b604a1 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:45.251849 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-1662e6e9-6652-470f-bf07-c720f8b604a1 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6" status: 200 len: 1314 microversion: 2.1 time: 0.151181 May 23 16:56:45.252526 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 477/930] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:45 2022] GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:56:46.269525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-4993fa08-76f2-49f7-9c0a-4ae79d6ff508 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:46.270152 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-4993fa08-76f2-49f7-9c0a-4ae79d6ff508 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: 081a9417-6f3a-436d-85ec-52ff0846efb6] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:46.273279 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=2 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:46.274069 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=6 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:46.278930 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4993fa08-76f2-49f7-9c0a-4ae79d6ff508 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:46.279380 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4993fa08-76f2-49f7-9c0a-4ae79d6ff508 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:46.285549 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4993fa08-76f2-49f7-9c0a-4ae79d6ff508 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:46.285549 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4993fa08-76f2-49f7-9c0a-4ae79d6ff508 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:46.415478 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-4993fa08-76f2-49f7-9c0a-4ae79d6ff508 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:46.423005 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-4993fa08-76f2-49f7-9c0a-4ae79d6ff508 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6" status: 200 len: 1314 microversion: 2.1 time: 0.157363 May 23 16:56:46.423573 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 454/931] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:46 2022] GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:56:47.440472 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e029dab8-e8f8-4207-a70e-13467177e364 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:47.441190 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e029dab8-e8f8-4207-a70e-13467177e364 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: 081a9417-6f3a-436d-85ec-52ff0846efb6] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:47.443109 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=2 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:47.449246 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e029dab8-e8f8-4207-a70e-13467177e364 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:47.449704 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e029dab8-e8f8-4207-a70e-13467177e364 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:47.450526 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e029dab8-e8f8-4207-a70e-13467177e364 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:47.450968 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e029dab8-e8f8-4207-a70e-13467177e364 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:47.586296 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e029dab8-e8f8-4207-a70e-13467177e364 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:47.593602 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e029dab8-e8f8-4207-a70e-13467177e364 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6" status: 200 len: 1314 microversion: 2.1 time: 0.157206 May 23 16:56:47.594160 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 478/932] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:47 2022] GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:56:48.610620 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-08b7d102-bf7f-4030-901b-9a4d3d357cd5 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:48.611279 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-08b7d102-bf7f-4030-901b-9a4d3d357cd5 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: 081a9417-6f3a-436d-85ec-52ff0846efb6] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:48.617972 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-08b7d102-bf7f-4030-901b-9a4d3d357cd5 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:48.618431 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-08b7d102-bf7f-4030-901b-9a4d3d357cd5 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:48.619206 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-08b7d102-bf7f-4030-901b-9a4d3d357cd5 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:48.619660 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-08b7d102-bf7f-4030-901b-9a4d3d357cd5 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:48.747718 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-08b7d102-bf7f-4030-901b-9a4d3d357cd5 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:48.755189 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-08b7d102-bf7f-4030-901b-9a4d3d357cd5 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6" status: 200 len: 1314 microversion: 2.1 time: 0.148468 May 23 16:56:48.755751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 455/933] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:48 2022] GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:56:48.891866 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-08fa5db4-f4a7-4b2b-900e-31d3be2c2b76 req-3848fad1-b35b-4f37-989a-684861090176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "081a9417-6f3a-436d-85ec-52ff0846efb6", "name": "network-vif-plugged", "status": "completed", "tag": "39215849-d947-4102-9719-0ea50d8320a5"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:56:48.901839 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-08fa5db4-f4a7-4b2b-900e-31d3be2c2b76 req-3848fad1-b35b-4f37-989a-684861090176 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:48.902286 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-08fa5db4-f4a7-4b2b-900e-31d3be2c2b76 req-3848fad1-b35b-4f37-989a-684861090176 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:48.919598 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-08fa5db4-f4a7-4b2b-900e-31d3be2c2b76 req-3848fad1-b35b-4f37-989a-684861090176 service nova] Creating event network-vif-plugged:39215849-d947-4102-9719-0ea50d8320a5 for instance 081a9417-6f3a-436d-85ec-52ff0846efb6 on hv-cinder-83925 May 23 16:56:48.924579 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-08fa5db4-f4a7-4b2b-900e-31d3be2c2b76 req-3848fad1-b35b-4f37-989a-684861090176 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036544 May 23 16:56:48.925168 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 479/934] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:56:49.773296 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-81bb9d2d-e622-4550-9e99-b16a646fe70e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:49.773921 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-81bb9d2d-e622-4550-9e99-b16a646fe70e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: 081a9417-6f3a-436d-85ec-52ff0846efb6] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:49.780549 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-81bb9d2d-e622-4550-9e99-b16a646fe70e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:49.781001 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-81bb9d2d-e622-4550-9e99-b16a646fe70e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:49.781757 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-81bb9d2d-e622-4550-9e99-b16a646fe70e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:49.782192 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-81bb9d2d-e622-4550-9e99-b16a646fe70e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:49.913124 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-81bb9d2d-e622-4550-9e99-b16a646fe70e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:49.920541 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-81bb9d2d-e622-4550-9e99-b16a646fe70e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6" status: 200 len: 1314 microversion: 2.1 time: 0.151804 May 23 16:56:49.921107 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 456/935] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:49 2022] GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:56:50.940370 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-f8d0c021-5245-47a7-aae4-5543b02fd028 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:50.941101 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-f8d0c021-5245-47a7-aae4-5543b02fd028 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: 081a9417-6f3a-436d-85ec-52ff0846efb6] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:50.947325 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f8d0c021-5245-47a7-aae4-5543b02fd028 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:50.951136 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f8d0c021-5245-47a7-aae4-5543b02fd028 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:50.951136 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f8d0c021-5245-47a7-aae4-5543b02fd028 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:50.951136 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f8d0c021-5245-47a7-aae4-5543b02fd028 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:51.083703 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f8d0c021-5245-47a7-aae4-5543b02fd028 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:51.091464 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-f8d0c021-5245-47a7-aae4-5543b02fd028 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6" status: 200 len: 1314 microversion: 2.1 time: 0.156121 May 23 16:56:51.092061 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 480/936] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:50 2022] GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:56:52.109411 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-f786dc32-96b0-4105-a916-abcbc4629d69 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:52.110040 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-f786dc32-96b0-4105-a916-abcbc4629d69 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: 081a9417-6f3a-436d-85ec-52ff0846efb6] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:52.118476 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f786dc32-96b0-4105-a916-abcbc4629d69 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:52.118932 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f786dc32-96b0-4105-a916-abcbc4629d69 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:52.119806 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f786dc32-96b0-4105-a916-abcbc4629d69 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:52.120193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f786dc32-96b0-4105-a916-abcbc4629d69 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:52.260949 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-f786dc32-96b0-4105-a916-abcbc4629d69 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:52.268524 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-f786dc32-96b0-4105-a916-abcbc4629d69 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6" status: 200 len: 1498 microversion: 2.1 time: 0.163091 May 23 16:56:52.269102 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 457/937] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:52 2022] GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6 => generated 1498 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:56:53.086351 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-24bacdba-382f-4682-abcb-1b608aa7d30b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:53.086861 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-24bacdba-382f-4682-abcb-1b608aa7d30b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: 081a9417-6f3a-436d-85ec-52ff0846efb6] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:53.093406 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-24bacdba-382f-4682-abcb-1b608aa7d30b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:53.093851 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-24bacdba-382f-4682-abcb-1b608aa7d30b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:53.094608 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-24bacdba-382f-4682-abcb-1b608aa7d30b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:53.095045 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-24bacdba-382f-4682-abcb-1b608aa7d30b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:53.122776 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-24bacdba-382f-4682-abcb-1b608aa7d30b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: 081a9417-6f3a-436d-85ec-52ff0846efb6] Going to try to terminate instance {{(pid=124715) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 16:56:53.401111 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-24bacdba-382f-4682-abcb-1b608aa7d30b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "DELETE /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6" status: 204 len: 0 microversion: 2.1 time: 0.319182 May 23 16:56:53.401628 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 481/938] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 16:56:53 2022] DELETE /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 16:56:53.409842 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-0832a294-035e-455f-bf86-d8eeca60cbd2 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:53.410693 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-0832a294-035e-455f-bf86-d8eeca60cbd2 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: 081a9417-6f3a-436d-85ec-52ff0846efb6] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:53.417653 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0832a294-035e-455f-bf86-d8eeca60cbd2 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:53.418099 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0832a294-035e-455f-bf86-d8eeca60cbd2 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:53.418857 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0832a294-035e-455f-bf86-d8eeca60cbd2 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:53.419292 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0832a294-035e-455f-bf86-d8eeca60cbd2 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:53.556315 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-0832a294-035e-455f-bf86-d8eeca60cbd2 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:53.563640 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-0832a294-035e-455f-bf86-d8eeca60cbd2 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6" status: 200 len: 1504 microversion: 2.1 time: 0.157745 May 23 16:56:53.564198 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 458/939] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:53 2022] GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:56:54.592403 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-64ebea21-a263-41fc-a178-047a4be30096 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:54.593128 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-64ebea21-a263-41fc-a178-047a4be30096 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: 081a9417-6f3a-436d-85ec-52ff0846efb6] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:54.599513 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-64ebea21-a263-41fc-a178-047a4be30096 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:54.599957 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-64ebea21-a263-41fc-a178-047a4be30096 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:54.600739 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-64ebea21-a263-41fc-a178-047a4be30096 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:54.601172 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-64ebea21-a263-41fc-a178-047a4be30096 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:54.735236 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-64ebea21-a263-41fc-a178-047a4be30096 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:54.743395 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-64ebea21-a263-41fc-a178-047a4be30096 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6" status: 200 len: 1504 microversion: 2.1 time: 0.155270 May 23 16:56:54.743950 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 482/940] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:54 2022] GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:56:55.661737 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-c6a1859b-f0be-4223-b483-39fc149957b9 req-53a232e9-f4a3-4bd4-a05d-c831afad4d62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "081a9417-6f3a-436d-85ec-52ff0846efb6", "name": "network-vif-deleted", "tag": "39215849-d947-4102-9719-0ea50d8320a5"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:56:55.670450 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-c6a1859b-f0be-4223-b483-39fc149957b9 req-53a232e9-f4a3-4bd4-a05d-c831afad4d62 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:55.673386 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-c6a1859b-f0be-4223-b483-39fc149957b9 req-53a232e9-f4a3-4bd4-a05d-c831afad4d62 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:55.682524 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-c6a1859b-f0be-4223-b483-39fc149957b9 req-53a232e9-f4a3-4bd4-a05d-c831afad4d62 service nova] Creating event network-vif-deleted:39215849-d947-4102-9719-0ea50d8320a5 for instance 081a9417-6f3a-436d-85ec-52ff0846efb6 on hv-cinder-83925 May 23 16:56:55.687661 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-c6a1859b-f0be-4223-b483-39fc149957b9 req-53a232e9-f4a3-4bd4-a05d-c831afad4d62 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029820 May 23 16:56:55.688262 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 459/941] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:56:55.760779 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-80e2e3a1-0ab7-430d-9fe1-e932a8efe904 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:55.761400 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-80e2e3a1-0ab7-430d-9fe1-e932a8efe904 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: 081a9417-6f3a-436d-85ec-52ff0846efb6] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:55.768205 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-80e2e3a1-0ab7-430d-9fe1-e932a8efe904 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:55.768708 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-80e2e3a1-0ab7-430d-9fe1-e932a8efe904 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:55.769497 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-80e2e3a1-0ab7-430d-9fe1-e932a8efe904 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:55.769924 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-80e2e3a1-0ab7-430d-9fe1-e932a8efe904 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:55.837131 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-80e2e3a1-0ab7-430d-9fe1-e932a8efe904 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:55.846682 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-80e2e3a1-0ab7-430d-9fe1-e932a8efe904 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6" status: 200 len: 1462 microversion: 2.1 time: 0.090311 May 23 16:56:55.847432 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 483/942] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:55 2022] GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6 => generated 1462 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:56:56.865171 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-970e9b15-bd88-47ba-8254-8068bdab68f6 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:56.865885 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-970e9b15-bd88-47ba-8254-8068bdab68f6 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: 081a9417-6f3a-436d-85ec-52ff0846efb6] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:56.873060 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-970e9b15-bd88-47ba-8254-8068bdab68f6 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:56.873515 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-970e9b15-bd88-47ba-8254-8068bdab68f6 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:56.874285 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-970e9b15-bd88-47ba-8254-8068bdab68f6 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:56.874726 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-970e9b15-bd88-47ba-8254-8068bdab68f6 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:56.889521 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-970e9b15-bd88-47ba-8254-8068bdab68f6 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] HTTP exception thrown: Instance 081a9417-6f3a-436d-85ec-52ff0846efb6 could not be found. May 23 16:56:56.891247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-970e9b15-bd88-47ba-8254-8068bdab68f6 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Request method failure captured: May 23 16:56:56.891247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6 HTTP/1.1 May 23 16:56:56.891247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:56:56.891247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:56:56.891247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:56:56.891247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 16:56:56.891247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:56:56.891247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:56:56.891247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:56:56.891247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:56:56.891247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7zB_M-kWecorQ_htZRVMB36ofgKSzgr3wAxbGZnxgASaWVU000kHGNTi_IFHMetIdi1aWytQiIT8OBqa4AuIA6Blxyuwfc1YtJhkjzvSrGTMikcwgbc4lmAf-qt_6JBAbHCT_18m3-BT9I_DaDHjeCveMc3_K2hdXPkfT6BAW7_yys May 23 16:56:56.891247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:56:56.891247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:56:56.891247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:56:56.891247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:56:56.891247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:56:56.891247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:56:56.891247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: 8accbe2ccd0d415fa3f31e3b0f6298db May 23 16:56:56.891247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-VolumesActionsTest-1549263903 May 23 16:56:56.891247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:56:56.891247 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:56:56.892736 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8accbe2ccd0d415fa3f31e3b0f6298db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8accbe2ccd0d415fa3f31e3b0f6298db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8accbe2ccd0d415fa3f31e3b0f6298db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8accbe2ccd0d415fa3f31e3b0f6298db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:56:56.892736 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-VolumesActionsTest-1549263903 May 23 16:56:56.892736 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: 8accbe2ccd0d415fa3f31e3b0f6298db May 23 16:56:56.892736 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-VolumesActionsTest-1549263903 May 23 16:56:56.892736 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-VolumesActionsTest-1549263903-project May 23 16:56:56.892736 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:56:56.892736 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:56:56.892736 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: b78d8e7ea1c24cc5ba664b410e7ed39a May 23 16:56:56.892736 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-VolumesActionsTest-1549263903-project May 23 16:56:56.892736 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: > May 23 16:56:56.892736 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Instance 081a9417-6f3a-436d-85ec-52ff0846efb6 could not be found. May 23 16:56:56.892736 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': '081a9417-6f3a-436d-85ec-52ff0846efb6'} May 23 16:56:56.893591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:56:56.893591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:56.893591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:56:56.893591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:56:56.893591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:56:56.893591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:56:56.893591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:56:56.893591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:56:56.893591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:56:56.893591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:56:56.893591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 081a9417-6f3a-436d-85ec-52ff0846efb6 could not be found. May 23 16:56:56.893591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:56.893591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:56.893591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:56.893591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:56.893591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:56.893591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:56.893591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:56:56.893591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:56:56.893591 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:56:56.895163 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:56:56.895163 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:56:56.895163 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:56:56.895163 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:56:56.895163 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:56:56.895163 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:56:56.895163 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:56:56.895163 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 081a9417-6f3a-436d-85ec-52ff0846efb6 could not be found. May 23 16:56:56.895163 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:56.895163 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:56:56.895163 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:56.895163 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:56:56.895163 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:56:56.895163 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:56:56.895163 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:56:56.895163 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:56:56.895163 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 081a9417-6f3a-436d-85ec-52ff0846efb6 could not be found. May 23 16:56:56.895163 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:56:56.896550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-970e9b15-bd88-47ba-8254-8068bdab68f6 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Returning 404 to user: Instance 081a9417-6f3a-436d-85ec-52ff0846efb6 could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:56:56.896550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-970e9b15-bd88-47ba-8254-8068bdab68f6 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6" status: 404 len: 111 microversion: 2.1 time: 0.032392 May 23 16:56:56.896550 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 460/943] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:56 2022] GET /compute/v2.1/servers/081a9417-6f3a-436d-85ec-52ff0846efb6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:56:56.993541 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-494596de-a192-49a9-8263-b7bcdde7847b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1186961543", "imageRef": "96972e76-879d-4149-a713-a94529892aad", "flavorRef": "452", "networks": [{"uuid": "27e901e8-80f2-4802-ac5f-dae1e13097cd"}]}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:56:57.048242 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.network.neutron [None req-494596de-a192-49a9-8263-b7bcdde7847b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] validate_networks() for [('27e901e8-80f2-4802-ac5f-dae1e13097cd', None, None, None, None, None)] {{(pid=124715) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 16:56:57.529620 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-494596de-a192-49a9-8263-b7bcdde7847b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Flavor limits 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 16:56:57.529620 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-494596de-a192-49a9-8263-b7bcdde7847b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Image limits 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 16:56:57.529620 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-494596de-a192-49a9-8263-b7bcdde7847b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Flavor pref 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 16:56:57.529620 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-494596de-a192-49a9-8263-b7bcdde7847b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Image pref 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 16:56:57.529620 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-494596de-a192-49a9-8263-b7bcdde7847b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 16:56:57.544672 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-494596de-a192-49a9-8263-b7bcdde7847b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:57.545425 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-494596de-a192-49a9-8263-b7bcdde7847b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:57.546759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-494596de-a192-49a9-8263-b7bcdde7847b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:57.547498 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-494596de-a192-49a9-8263-b7bcdde7847b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:57.576385 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-494596de-a192-49a9-8263-b7bcdde7847b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Getting quotas for project 8accbe2ccd0d415fa3f31e3b0f6298db. Resources: {'cores', 'instances', 'ram'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:56:57.583102 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-494596de-a192-49a9-8263-b7bcdde7847b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Getting quotas for user b78d8e7ea1c24cc5ba664b410e7ed39a and project 8accbe2ccd0d415fa3f31e3b0f6298db. Resources: {'cores', 'instances', 'ram'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:56:57.602595 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-494596de-a192-49a9-8263-b7bcdde7847b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Going to run 1 instances... {{(pid=124715) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 16:56:57.605813 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-494596de-a192-49a9-8263-b7bcdde7847b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: cb4db718-2f94-4611-a9f2-cc3118ecaf97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96972e76-879d-4149-a713-a94529892aad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 16:56:57.742677 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-494596de-a192-49a9-8263-b7bcdde7847b tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.753087 May 23 16:56:57.743637 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 484/944] 10.222.0.74 () {60 vars in 1146 bytes} [Mon May 23 16:56:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 16:56:57.754140 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-56662f05-d706-4aa0-bbd5-1350d176d441 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:57.754799 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-56662f05-d706-4aa0-bbd5-1350d176d441 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: cb4db718-2f94-4611-a9f2-cc3118ecaf97] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:57.826047 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-56662f05-d706-4aa0-bbd5-1350d176d441 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:57.834396 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-56662f05-d706-4aa0-bbd5-1350d176d441 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97" status: 200 len: 1214 microversion: 2.1 time: 0.084255 May 23 16:56:57.835041 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 461/945] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:57 2022] GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:56:58.852090 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-faaf50b7-9d48-4c0b-8fd2-9b70e04f388d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:58.852876 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-faaf50b7-9d48-4c0b-8fd2-9b70e04f388d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: cb4db718-2f94-4611-a9f2-cc3118ecaf97] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:58.854852 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:58.860542 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-faaf50b7-9d48-4c0b-8fd2-9b70e04f388d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:58.860999 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-faaf50b7-9d48-4c0b-8fd2-9b70e04f388d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:58.861779 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-faaf50b7-9d48-4c0b-8fd2-9b70e04f388d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:58.862224 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-faaf50b7-9d48-4c0b-8fd2-9b70e04f388d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:58.866996 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:58.925120 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-faaf50b7-9d48-4c0b-8fd2-9b70e04f388d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:56:58.933221 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-faaf50b7-9d48-4c0b-8fd2-9b70e04f388d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97" status: 200 len: 1218 microversion: 2.1 time: 0.085518 May 23 16:56:58.933898 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 485/946] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:58 2022] GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:56:59.952175 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-02ad14a2-0585-45c4-819e-359c4310da47 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:56:59.952927 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-02ad14a2-0585-45c4-819e-359c4310da47 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: cb4db718-2f94-4611-a9f2-cc3118ecaf97] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:56:59.961039 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:56:59.967797 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-02ad14a2-0585-45c4-819e-359c4310da47 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:59.967797 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-02ad14a2-0585-45c4-819e-359c4310da47 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:56:59.967797 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-02ad14a2-0585-45c4-819e-359c4310da47 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:56:59.967797 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-02ad14a2-0585-45c4-819e-359c4310da47 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:00.005770 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=57 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:00.059147 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-02ad14a2-0585-45c4-819e-359c4310da47 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:00.066864 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-02ad14a2-0585-45c4-819e-359c4310da47 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97" status: 200 len: 1284 microversion: 2.1 time: 0.119025 May 23 16:57:00.067440 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 462/947] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:56:59 2022] GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97 => generated 1284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:57:01.084131 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-94d7fc61-2f3b-4722-a1a8-d50575c6faba tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:01.085426 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-94d7fc61-2f3b-4722-a1a8-d50575c6faba tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: cb4db718-2f94-4611-a9f2-cc3118ecaf97] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:01.093557 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-94d7fc61-2f3b-4722-a1a8-d50575c6faba tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:01.094010 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-94d7fc61-2f3b-4722-a1a8-d50575c6faba tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:01.094783 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-94d7fc61-2f3b-4722-a1a8-d50575c6faba tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:01.095225 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-94d7fc61-2f3b-4722-a1a8-d50575c6faba tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:01.248902 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-94d7fc61-2f3b-4722-a1a8-d50575c6faba tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:01.256989 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-94d7fc61-2f3b-4722-a1a8-d50575c6faba tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97" status: 200 len: 1314 microversion: 2.1 time: 0.176965 May 23 16:57:01.260095 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 486/948] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:01 2022] GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:57:01.600402 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-ce7446d9-ad1b-4c89-b2d3-ace4723abb1e req-cce275b5-5c4f-4981-beba-0b8379e3af94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb4db718-2f94-4611-a9f2-cc3118ecaf97", "tag": "d1669f51-e28b-4d0d-84b3-a8ad66f78abd"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:57:01.605127 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-ce7446d9-ad1b-4c89-b2d3-ace4723abb1e req-cce275b5-5c4f-4981-beba-0b8379e3af94 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:01.606107 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-ce7446d9-ad1b-4c89-b2d3-ace4723abb1e req-cce275b5-5c4f-4981-beba-0b8379e3af94 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:01.618206 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-ce7446d9-ad1b-4c89-b2d3-ace4723abb1e req-cce275b5-5c4f-4981-beba-0b8379e3af94 service nova] Creating event network-changed:d1669f51-e28b-4d0d-84b3-a8ad66f78abd for instance cb4db718-2f94-4611-a9f2-cc3118ecaf97 on hv-cinder-83925 May 23 16:57:01.623014 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-ce7446d9-ad1b-4c89-b2d3-ace4723abb1e req-cce275b5-5c4f-4981-beba-0b8379e3af94 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036284 May 23 16:57:01.626533 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 463/949] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:57:02.274196 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-fed8be93-14ea-49f8-bb1f-753cdcf47c66 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:02.274822 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-fed8be93-14ea-49f8-bb1f-753cdcf47c66 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: cb4db718-2f94-4611-a9f2-cc3118ecaf97] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:02.281321 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fed8be93-14ea-49f8-bb1f-753cdcf47c66 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:02.281774 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fed8be93-14ea-49f8-bb1f-753cdcf47c66 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:02.282551 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fed8be93-14ea-49f8-bb1f-753cdcf47c66 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:02.282990 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fed8be93-14ea-49f8-bb1f-753cdcf47c66 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:02.423688 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-fed8be93-14ea-49f8-bb1f-753cdcf47c66 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:02.429909 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-fed8be93-14ea-49f8-bb1f-753cdcf47c66 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97" status: 200 len: 1314 microversion: 2.1 time: 0.159492 May 23 16:57:02.430489 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 487/950] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:02 2022] GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:57:03.448513 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-4a43a119-6f8a-4665-bad3-5f84e3a40284 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:03.449220 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-4a43a119-6f8a-4665-bad3-5f84e3a40284 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: cb4db718-2f94-4611-a9f2-cc3118ecaf97] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:03.455427 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4a43a119-6f8a-4665-bad3-5f84e3a40284 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:03.455878 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4a43a119-6f8a-4665-bad3-5f84e3a40284 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:03.456675 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4a43a119-6f8a-4665-bad3-5f84e3a40284 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:03.457370 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4a43a119-6f8a-4665-bad3-5f84e3a40284 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:03.590068 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-4a43a119-6f8a-4665-bad3-5f84e3a40284 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:03.597731 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-4a43a119-6f8a-4665-bad3-5f84e3a40284 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97" status: 200 len: 1314 microversion: 2.1 time: 0.154738 May 23 16:57:03.598541 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 464/951] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:03 2022] GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:57:04.614750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-2e610f85-bc58-45b4-a0f8-91df2ebf302e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:04.615409 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-2e610f85-bc58-45b4-a0f8-91df2ebf302e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: cb4db718-2f94-4611-a9f2-cc3118ecaf97] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:04.622545 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2e610f85-bc58-45b4-a0f8-91df2ebf302e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:04.623005 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2e610f85-bc58-45b4-a0f8-91df2ebf302e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:04.623781 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2e610f85-bc58-45b4-a0f8-91df2ebf302e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:04.624225 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2e610f85-bc58-45b4-a0f8-91df2ebf302e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:04.751455 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-2e610f85-bc58-45b4-a0f8-91df2ebf302e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:04.758977 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-2e610f85-bc58-45b4-a0f8-91df2ebf302e tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97" status: 200 len: 1314 microversion: 2.1 time: 0.148127 May 23 16:57:04.759540 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 488/952] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:04 2022] GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:57:05.775904 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-f0aeea1f-a0fe-47d7-ae0f-19dc27dfb54f tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:05.776483 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-f0aeea1f-a0fe-47d7-ae0f-19dc27dfb54f tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: cb4db718-2f94-4611-a9f2-cc3118ecaf97] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:05.782937 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f0aeea1f-a0fe-47d7-ae0f-19dc27dfb54f tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:05.783388 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f0aeea1f-a0fe-47d7-ae0f-19dc27dfb54f tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:05.784153 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f0aeea1f-a0fe-47d7-ae0f-19dc27dfb54f tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:05.784627 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f0aeea1f-a0fe-47d7-ae0f-19dc27dfb54f tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:05.919952 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-f0aeea1f-a0fe-47d7-ae0f-19dc27dfb54f tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:05.927419 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-f0aeea1f-a0fe-47d7-ae0f-19dc27dfb54f tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97" status: 200 len: 1314 microversion: 2.1 time: 0.156157 May 23 16:57:05.927981 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 465/953] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:05 2022] GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:57:06.945264 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-794ea7ab-5ddc-48a9-b7df-122f6da8c6c5 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:06.946130 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-794ea7ab-5ddc-48a9-b7df-122f6da8c6c5 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: cb4db718-2f94-4611-a9f2-cc3118ecaf97] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:06.952673 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-794ea7ab-5ddc-48a9-b7df-122f6da8c6c5 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:06.953133 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-794ea7ab-5ddc-48a9-b7df-122f6da8c6c5 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:06.953908 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-794ea7ab-5ddc-48a9-b7df-122f6da8c6c5 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:06.954353 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-794ea7ab-5ddc-48a9-b7df-122f6da8c6c5 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:07.088719 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-794ea7ab-5ddc-48a9-b7df-122f6da8c6c5 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:07.096193 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-794ea7ab-5ddc-48a9-b7df-122f6da8c6c5 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97" status: 200 len: 1314 microversion: 2.1 time: 0.155001 May 23 16:57:07.096791 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 489/954] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:06 2022] GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:57:08.113699 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-30d12506-5f22-4cc4-9f71-2f4d0bf142d0 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:08.114321 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-30d12506-5f22-4cc4-9f71-2f4d0bf142d0 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: cb4db718-2f94-4611-a9f2-cc3118ecaf97] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:08.117319 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=2 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:08.122323 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-30d12506-5f22-4cc4-9f71-2f4d0bf142d0 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:08.122787 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-30d12506-5f22-4cc4-9f71-2f4d0bf142d0 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:08.123611 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-30d12506-5f22-4cc4-9f71-2f4d0bf142d0 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:08.124008 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-30d12506-5f22-4cc4-9f71-2f4d0bf142d0 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:08.261131 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-30d12506-5f22-4cc4-9f71-2f4d0bf142d0 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:08.268508 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-30d12506-5f22-4cc4-9f71-2f4d0bf142d0 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97" status: 200 len: 1314 microversion: 2.1 time: 0.158799 May 23 16:57:08.269069 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 466/955] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:08 2022] GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:57:09.285835 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-f6006fb2-33cc-4a5b-b47e-fb5fa83bb2a8 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:09.286828 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-f6006fb2-33cc-4a5b-b47e-fb5fa83bb2a8 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: cb4db718-2f94-4611-a9f2-cc3118ecaf97] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:09.288452 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=2 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:09.289103 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=6 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:09.293859 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f6006fb2-33cc-4a5b-b47e-fb5fa83bb2a8 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:09.294312 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f6006fb2-33cc-4a5b-b47e-fb5fa83bb2a8 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:09.296451 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f6006fb2-33cc-4a5b-b47e-fb5fa83bb2a8 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:09.296451 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f6006fb2-33cc-4a5b-b47e-fb5fa83bb2a8 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:09.430143 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f6006fb2-33cc-4a5b-b47e-fb5fa83bb2a8 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:09.437797 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-f6006fb2-33cc-4a5b-b47e-fb5fa83bb2a8 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97" status: 200 len: 1314 microversion: 2.1 time: 0.156003 May 23 16:57:09.438374 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 490/956] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:09 2022] GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:57:10.454410 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ad04e915-b1d8-4ee7-872c-63bc7e5871bc tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:10.455044 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ad04e915-b1d8-4ee7-872c-63bc7e5871bc tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: cb4db718-2f94-4611-a9f2-cc3118ecaf97] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:10.462733 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ad04e915-b1d8-4ee7-872c-63bc7e5871bc tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:10.463186 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ad04e915-b1d8-4ee7-872c-63bc7e5871bc tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:10.464045 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ad04e915-b1d8-4ee7-872c-63bc7e5871bc tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:10.464519 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ad04e915-b1d8-4ee7-872c-63bc7e5871bc tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:10.590466 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ad04e915-b1d8-4ee7-872c-63bc7e5871bc tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:10.597880 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ad04e915-b1d8-4ee7-872c-63bc7e5871bc tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97" status: 200 len: 1314 microversion: 2.1 time: 0.147289 May 23 16:57:10.598451 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 467/957] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:10 2022] GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:57:11.615166 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-d0098146-181a-4416-90ff-f7c902d5217d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:11.616215 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-d0098146-181a-4416-90ff-f7c902d5217d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: cb4db718-2f94-4611-a9f2-cc3118ecaf97] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:11.622960 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d0098146-181a-4416-90ff-f7c902d5217d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:11.623417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d0098146-181a-4416-90ff-f7c902d5217d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:11.624230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d0098146-181a-4416-90ff-f7c902d5217d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:11.624702 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d0098146-181a-4416-90ff-f7c902d5217d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:11.757271 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d0098146-181a-4416-90ff-f7c902d5217d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:11.764803 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-d0098146-181a-4416-90ff-f7c902d5217d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97" status: 200 len: 1314 microversion: 2.1 time: 0.153556 May 23 16:57:11.765382 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 491/958] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:11 2022] GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:57:12.783305 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7dba0d94-80e4-4fa2-b806-9071ea51026d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:12.783945 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-7dba0d94-80e4-4fa2-b806-9071ea51026d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: cb4db718-2f94-4611-a9f2-cc3118ecaf97] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:12.792042 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7dba0d94-80e4-4fa2-b806-9071ea51026d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:12.792544 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7dba0d94-80e4-4fa2-b806-9071ea51026d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:12.793371 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7dba0d94-80e4-4fa2-b806-9071ea51026d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:12.794309 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7dba0d94-80e4-4fa2-b806-9071ea51026d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:12.835768 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-12af7d50-3d4a-47ac-bc32-0a1bef3e9360 req-f8ab5a2a-87bd-4eab-971a-0518b8ec1638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4db718-2f94-4611-a9f2-cc3118ecaf97", "name": "network-vif-plugged", "status": "completed", "tag": "d1669f51-e28b-4d0d-84b3-a8ad66f78abd"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:57:12.842504 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-12af7d50-3d4a-47ac-bc32-0a1bef3e9360 req-f8ab5a2a-87bd-4eab-971a-0518b8ec1638 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:12.842953 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-12af7d50-3d4a-47ac-bc32-0a1bef3e9360 req-f8ab5a2a-87bd-4eab-971a-0518b8ec1638 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:12.854881 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-12af7d50-3d4a-47ac-bc32-0a1bef3e9360 req-f8ab5a2a-87bd-4eab-971a-0518b8ec1638 service nova] Creating event network-vif-plugged:d1669f51-e28b-4d0d-84b3-a8ad66f78abd for instance cb4db718-2f94-4611-a9f2-cc3118ecaf97 on hv-cinder-83925 May 23 16:57:12.860176 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-12af7d50-3d4a-47ac-bc32-0a1bef3e9360 req-f8ab5a2a-87bd-4eab-971a-0518b8ec1638 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143961 May 23 16:57:12.860833 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 468/959] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:57:12.933981 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-7dba0d94-80e4-4fa2-b806-9071ea51026d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:12.941451 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-7dba0d94-80e4-4fa2-b806-9071ea51026d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97" status: 200 len: 1314 microversion: 2.1 time: 0.162845 May 23 16:57:12.944843 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 492/960] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:12 2022] GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:57:13.960527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-abe769ec-4847-4ebe-8c3a-4e4183f15310 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:13.961233 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-abe769ec-4847-4ebe-8c3a-4e4183f15310 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: cb4db718-2f94-4611-a9f2-cc3118ecaf97] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:13.967450 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-abe769ec-4847-4ebe-8c3a-4e4183f15310 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:13.967900 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-abe769ec-4847-4ebe-8c3a-4e4183f15310 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:13.968693 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-abe769ec-4847-4ebe-8c3a-4e4183f15310 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:13.969136 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-abe769ec-4847-4ebe-8c3a-4e4183f15310 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:14.103899 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-abe769ec-4847-4ebe-8c3a-4e4183f15310 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:14.111342 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-abe769ec-4847-4ebe-8c3a-4e4183f15310 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97" status: 200 len: 1314 microversion: 2.1 time: 0.156078 May 23 16:57:14.116579 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 469/961] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:13 2022] GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:57:15.128773 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-2a81be3e-603e-48e9-986c-1823d5cbea05 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:15.129394 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-2a81be3e-603e-48e9-986c-1823d5cbea05 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: cb4db718-2f94-4611-a9f2-cc3118ecaf97] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:15.136503 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2a81be3e-603e-48e9-986c-1823d5cbea05 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:15.136959 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2a81be3e-603e-48e9-986c-1823d5cbea05 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:15.137728 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2a81be3e-603e-48e9-986c-1823d5cbea05 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:15.138170 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2a81be3e-603e-48e9-986c-1823d5cbea05 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:15.266897 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-2a81be3e-603e-48e9-986c-1823d5cbea05 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:15.275066 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-2a81be3e-603e-48e9-986c-1823d5cbea05 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97" status: 200 len: 1499 microversion: 2.1 time: 0.150267 May 23 16:57:15.275638 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 493/962] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:15 2022] GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97 => generated 1499 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:57:16.024225 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-912d9f22-d491-40a4-b4ec-5b341d5edf72 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:16.025319 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-912d9f22-d491-40a4-b4ec-5b341d5edf72 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: cb4db718-2f94-4611-a9f2-cc3118ecaf97] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:16.031808 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-912d9f22-d491-40a4-b4ec-5b341d5edf72 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:16.032252 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-912d9f22-d491-40a4-b4ec-5b341d5edf72 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:16.033277 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-912d9f22-d491-40a4-b4ec-5b341d5edf72 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:16.033727 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-912d9f22-d491-40a4-b4ec-5b341d5edf72 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:16.059303 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-912d9f22-d491-40a4-b4ec-5b341d5edf72 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: cb4db718-2f94-4611-a9f2-cc3118ecaf97] Going to try to terminate instance {{(pid=124714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 16:57:16.400829 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-912d9f22-d491-40a4-b4ec-5b341d5edf72 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "DELETE /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97" status: 204 len: 0 microversion: 2.1 time: 0.380816 May 23 16:57:16.402897 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 470/963] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 16:57:16 2022] DELETE /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 16:57:16.409965 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-49fb8cd5-5618-42dd-b299-90f967e53dc4 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:16.410614 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-49fb8cd5-5618-42dd-b299-90f967e53dc4 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: cb4db718-2f94-4611-a9f2-cc3118ecaf97] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:16.418799 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-49fb8cd5-5618-42dd-b299-90f967e53dc4 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:16.419256 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-49fb8cd5-5618-42dd-b299-90f967e53dc4 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:16.420031 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-49fb8cd5-5618-42dd-b299-90f967e53dc4 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:16.420519 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-49fb8cd5-5618-42dd-b299-90f967e53dc4 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:16.555370 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-49fb8cd5-5618-42dd-b299-90f967e53dc4 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:16.562781 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-49fb8cd5-5618-42dd-b299-90f967e53dc4 tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97" status: 200 len: 1505 microversion: 2.1 time: 0.157013 May 23 16:57:16.563353 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 494/964] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:16 2022] GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:57:17.581953 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ccb5d6df-8bee-4b82-8ebd-a3534f66355c tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:17.582664 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ccb5d6df-8bee-4b82-8ebd-a3534f66355c tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: cb4db718-2f94-4611-a9f2-cc3118ecaf97] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:17.589804 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ccb5d6df-8bee-4b82-8ebd-a3534f66355c tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:17.590258 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ccb5d6df-8bee-4b82-8ebd-a3534f66355c tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:17.591030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ccb5d6df-8bee-4b82-8ebd-a3534f66355c tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:17.591513 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ccb5d6df-8bee-4b82-8ebd-a3534f66355c tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:17.724015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ccb5d6df-8bee-4b82-8ebd-a3534f66355c tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:17.732642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ccb5d6df-8bee-4b82-8ebd-a3534f66355c tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97" status: 200 len: 1505 microversion: 2.1 time: 0.156249 May 23 16:57:17.733214 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 471/965] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:17 2022] GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:57:18.326355 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-08acad09-eeea-410f-ad77-3011d508ed30 req-ae6b3590-9dc8-4bdd-b940-60f4ef127a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4db718-2f94-4611-a9f2-cc3118ecaf97", "name": "network-vif-deleted", "tag": "d1669f51-e28b-4d0d-84b3-a8ad66f78abd"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:57:18.336808 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-08acad09-eeea-410f-ad77-3011d508ed30 req-ae6b3590-9dc8-4bdd-b940-60f4ef127a4f service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:18.337271 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-08acad09-eeea-410f-ad77-3011d508ed30 req-ae6b3590-9dc8-4bdd-b940-60f4ef127a4f service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:18.348551 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-08acad09-eeea-410f-ad77-3011d508ed30 req-ae6b3590-9dc8-4bdd-b940-60f4ef127a4f service nova] Creating event network-vif-deleted:d1669f51-e28b-4d0d-84b3-a8ad66f78abd for instance cb4db718-2f94-4611-a9f2-cc3118ecaf97 on hv-cinder-83925 May 23 16:57:18.354201 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-08acad09-eeea-410f-ad77-3011d508ed30 req-ae6b3590-9dc8-4bdd-b940-60f4ef127a4f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031677 May 23 16:57:18.354783 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 495/966] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:57:18.749451 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-1ec5d68a-59b9-41e6-8bc0-16020955d1df tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:18.750041 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-1ec5d68a-59b9-41e6-8bc0-16020955d1df tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: cb4db718-2f94-4611-a9f2-cc3118ecaf97] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:18.757270 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1ec5d68a-59b9-41e6-8bc0-16020955d1df tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:18.757737 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1ec5d68a-59b9-41e6-8bc0-16020955d1df tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:18.758507 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1ec5d68a-59b9-41e6-8bc0-16020955d1df tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:18.758953 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1ec5d68a-59b9-41e6-8bc0-16020955d1df tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:18.790528 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1ec5d68a-59b9-41e6-8bc0-16020955d1df tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:18.790977 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1ec5d68a-59b9-41e6-8bc0-16020955d1df tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:18.791431 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.objects.instance [None req-1ec5d68a-59b9-41e6-8bc0-16020955d1df tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lazy-loading 'fault' on Instance uuid cb4db718-2f94-4611-a9f2-cc3118ecaf97 {{(pid=124714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:57:18.831789 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-1ec5d68a-59b9-41e6-8bc0-16020955d1df tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78d8e7ea1c24cc5ba664b410e7ed39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8accbe2ccd0d415fa3f31e3b0f6298db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:18.842237 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-1ec5d68a-59b9-41e6-8bc0-16020955d1df tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97" status: 200 len: 1304 microversion: 2.1 time: 0.096863 May 23 16:57:18.842815 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 472/967] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:18 2022] GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:57:19.860125 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-80faa6c5-b887-4a54-a9e5-893710a4479d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:19.860939 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-80faa6c5-b887-4a54-a9e5-893710a4479d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] [instance: cb4db718-2f94-4611-a9f2-cc3118ecaf97] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:19.868177 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-80faa6c5-b887-4a54-a9e5-893710a4479d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:19.868659 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-80faa6c5-b887-4a54-a9e5-893710a4479d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:19.869443 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-80faa6c5-b887-4a54-a9e5-893710a4479d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:19.869889 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-80faa6c5-b887-4a54-a9e5-893710a4479d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:19.884494 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-80faa6c5-b887-4a54-a9e5-893710a4479d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] HTTP exception thrown: Instance cb4db718-2f94-4611-a9f2-cc3118ecaf97 could not be found. May 23 16:57:19.886161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-80faa6c5-b887-4a54-a9e5-893710a4479d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Request method failure captured: May 23 16:57:19.886161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97 HTTP/1.1 May 23 16:57:19.886161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:57:19.886161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:57:19.886161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:57:19.886161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:57:19.886161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:57:19.886161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:57:19.886161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:57:19.886161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:57:19.886161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7zB_M-kWecorQ_htZRVMB36ofgKSzgr3wAxbGZnxgASaWVU000kHGNTi_IFHMetIdi1aWytQiIT8OBqa4AuIA6Blxyuwfc1YtJhkjzvSrGTMikcwgbc4lmAf-qt_6JBAbHCT_18m3-BT9I_DaDHjeCveMc3_K2hdXPkfT6BAW7_yys May 23 16:57:19.886161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:57:19.886161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:57:19.886161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:57:19.886161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:57:19.886161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:57:19.886161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:57:19.886161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: 8accbe2ccd0d415fa3f31e3b0f6298db May 23 16:57:19.886161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-VolumesActionsTest-1549263903 May 23 16:57:19.886161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:57:19.886161 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:57:19.887823 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8accbe2ccd0d415fa3f31e3b0f6298db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8accbe2ccd0d415fa3f31e3b0f6298db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8accbe2ccd0d415fa3f31e3b0f6298db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8accbe2ccd0d415fa3f31e3b0f6298db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:57:19.887823 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-VolumesActionsTest-1549263903 May 23 16:57:19.887823 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: 8accbe2ccd0d415fa3f31e3b0f6298db May 23 16:57:19.887823 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-VolumesActionsTest-1549263903 May 23 16:57:19.887823 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-VolumesActionsTest-1549263903-project May 23 16:57:19.887823 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:57:19.887823 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:57:19.887823 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: b78d8e7ea1c24cc5ba664b410e7ed39a May 23 16:57:19.887823 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-VolumesActionsTest-1549263903-project May 23 16:57:19.887823 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 16:57:19.887823 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Instance cb4db718-2f94-4611-a9f2-cc3118ecaf97 could not be found. May 23 16:57:19.887823 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': 'cb4db718-2f94-4611-a9f2-cc3118ecaf97'} May 23 16:57:19.888985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:57:19.888985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:57:19.888985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:57:19.888985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:57:19.888985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:57:19.888985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:57:19.888985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:57:19.888985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:57:19.888985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:57:19.888985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:57:19.888985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb4db718-2f94-4611-a9f2-cc3118ecaf97 could not be found. May 23 16:57:19.888985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:57:19.888985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:57:19.888985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:57:19.888985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:57:19.888985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:57:19.888985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:57:19.888985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:57:19.888985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:57:19.888985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:57:19.890552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:57:19.890552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:57:19.890552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:57:19.890552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:57:19.890552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:57:19.890552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:57:19.890552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:57:19.890552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb4db718-2f94-4611-a9f2-cc3118ecaf97 could not be found. May 23 16:57:19.890552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:57:19.890552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:57:19.890552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:57:19.890552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:57:19.890552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:57:19.890552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:57:19.890552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:57:19.890552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:57:19.890552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb4db718-2f94-4611-a9f2-cc3118ecaf97 could not be found. May 23 16:57:19.890552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:57:19.891783 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-80faa6c5-b887-4a54-a9e5-893710a4479d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] Returning 404 to user: Instance cb4db718-2f94-4611-a9f2-cc3118ecaf97 could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:57:19.891783 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-80faa6c5-b887-4a54-a9e5-893710a4479d tempest-VolumesActionsTest-1549263903 tempest-VolumesActionsTest-1549263903-project] 10.222.0.74 "GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97" status: 404 len: 111 microversion: 2.1 time: 0.032337 May 23 16:57:19.891783 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 496/968] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:19 2022] GET /compute/v2.1/servers/cb4db718-2f94-4611-a9f2-cc3118ecaf97 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:57:26.549321 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 16:57:26.549880 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Mon May 23 16:57:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 16:57:52.094647 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-bc1df69c-a55c-4a58-91bc-a358a72ffe7d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:52.095152 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-bc1df69c-a55c-4a58-91bc-a358a72ffe7d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:52.097471 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:52.098111 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:52.102991 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bc1df69c-a55c-4a58-91bc-a358a72ffe7d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:52.103442 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bc1df69c-a55c-4a58-91bc-a358a72ffe7d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:52.104207 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bc1df69c-a55c-4a58-91bc-a358a72ffe7d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:52.104667 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-bc1df69c-a55c-4a58-91bc-a358a72ffe7d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:52.130281 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-bc1df69c-a55c-4a58-91bc-a358a72ffe7d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Going to try to terminate instance {{(pid=124714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 16:57:52.502605 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-bc1df69c-a55c-4a58-91bc-a358a72ffe7d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "DELETE /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 204 len: 0 microversion: 2.1 time: 0.407220 May 23 16:57:52.502605 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 473/969] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 16:57:52 2022] DELETE /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 16:57:52.510054 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-d2876cef-ecbc-4d1d-8371-ebdeec34829b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:52.510682 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-d2876cef-ecbc-4d1d-8371-ebdeec34829b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:52.514198 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=23 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:52.514820 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=63 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:57:52.519083 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d2876cef-ecbc-4d1d-8371-ebdeec34829b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:52.519562 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d2876cef-ecbc-4d1d-8371-ebdeec34829b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:52.520564 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d2876cef-ecbc-4d1d-8371-ebdeec34829b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:52.521052 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d2876cef-ecbc-4d1d-8371-ebdeec34829b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:52.654239 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d2876cef-ecbc-4d1d-8371-ebdeec34829b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:52.662682 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-d2876cef-ecbc-4d1d-8371-ebdeec34829b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1577 microversion: 2.1 time: 0.157670 May 23 16:57:52.664018 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 497/970] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:52 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:57:53.681694 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-7af33670-9d73-4979-8a6c-e9a5b535d086 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:53.682399 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-7af33670-9d73-4979-8a6c-e9a5b535d086 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:53.689451 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7af33670-9d73-4979-8a6c-e9a5b535d086 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:53.689911 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7af33670-9d73-4979-8a6c-e9a5b535d086 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:53.690685 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7af33670-9d73-4979-8a6c-e9a5b535d086 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:53.691133 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7af33670-9d73-4979-8a6c-e9a5b535d086 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:53.863288 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7af33670-9d73-4979-8a6c-e9a5b535d086 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:53.870960 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-7af33670-9d73-4979-8a6c-e9a5b535d086 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1577 microversion: 2.1 time: 0.194018 May 23 16:57:53.871537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 474/971] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:53 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1577 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:57:54.892248 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c77f57fa-2a38-47a3-ad93-d766de9feb07 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:54.893037 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-c77f57fa-2a38-47a3-ad93-d766de9feb07 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:54.901686 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c77f57fa-2a38-47a3-ad93-d766de9feb07 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:54.902363 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c77f57fa-2a38-47a3-ad93-d766de9feb07 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:54.903330 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c77f57fa-2a38-47a3-ad93-d766de9feb07 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:54.903935 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c77f57fa-2a38-47a3-ad93-d766de9feb07 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:55.261489 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-c77f57fa-2a38-47a3-ad93-d766de9feb07 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:55.269124 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-c77f57fa-2a38-47a3-ad93-d766de9feb07 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1577 microversion: 2.1 time: 0.383436 May 23 16:57:55.270351 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 498/972] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:54 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1577 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:57:56.115229 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-c493893c-d38e-40bf-aa4a-b995b088defb req-3440cd09-cdfc-4b40-a45c-99a7052707d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e461f9e-4217-45ec-bf28-2a70f7ca0f82", "name": "network-vif-deleted", "tag": "9c208ee4-0165-4731-ad35-9eb054957a82"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:57:56.127780 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-c493893c-d38e-40bf-aa4a-b995b088defb req-3440cd09-cdfc-4b40-a45c-99a7052707d6 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:56.128743 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-c493893c-d38e-40bf-aa4a-b995b088defb req-3440cd09-cdfc-4b40-a45c-99a7052707d6 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:56.159184 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-c493893c-d38e-40bf-aa4a-b995b088defb req-3440cd09-cdfc-4b40-a45c-99a7052707d6 service nova] Creating event network-vif-deleted:9c208ee4-0165-4731-ad35-9eb054957a82 for instance 5e461f9e-4217-45ec-bf28-2a70f7ca0f82 on hv-cinder-83925 May 23 16:57:56.173739 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-c493893c-d38e-40bf-aa4a-b995b088defb req-3440cd09-cdfc-4b40-a45c-99a7052707d6 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062378 May 23 16:57:56.214887 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 475/973] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:57:56.288316 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-d6a4ac49-782b-4996-958e-a6114df24ee5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:56.289848 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-d6a4ac49-782b-4996-958e-a6114df24ee5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:56.315671 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d6a4ac49-782b-4996-958e-a6114df24ee5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:56.316935 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d6a4ac49-782b-4996-958e-a6114df24ee5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:56.317969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d6a4ac49-782b-4996-958e-a6114df24ee5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:56.318621 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d6a4ac49-782b-4996-958e-a6114df24ee5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:56.412252 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d6a4ac49-782b-4996-958e-a6114df24ee5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:56.422844 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-d6a4ac49-782b-4996-958e-a6114df24ee5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1225 microversion: 2.1 time: 0.138401 May 23 16:57:56.429625 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 499/974] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:56 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1225 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:57:56.904608 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-7c0ed744-8283-4668-983e-a6675bd515af tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-569428874", "imageRef": "96972e76-879d-4149-a713-a94529892aad", "flavorRef": "452"}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:57:56.961474 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.network.neutron [None req-7c0ed744-8283-4668-983e-a6675bd515af tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] validate_networks() for None {{(pid=124714) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 16:57:57.339427 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-7c0ed744-8283-4668-983e-a6675bd515af tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Flavor limits 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 16:57:57.340035 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-7c0ed744-8283-4668-983e-a6675bd515af tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Image limits 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 16:57:57.340592 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-7c0ed744-8283-4668-983e-a6675bd515af tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Flavor pref 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 16:57:57.341007 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-7c0ed744-8283-4668-983e-a6675bd515af tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Image pref 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 16:57:57.341574 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-7c0ed744-8283-4668-983e-a6675bd515af tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 16:57:57.354794 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7c0ed744-8283-4668-983e-a6675bd515af tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:57.354794 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7c0ed744-8283-4668-983e-a6675bd515af tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:57.354794 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7c0ed744-8283-4668-983e-a6675bd515af tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:57.354794 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7c0ed744-8283-4668-983e-a6675bd515af tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:57.378226 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-7c0ed744-8283-4668-983e-a6675bd515af tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Getting quotas for project 76512cf5f51b4bc9a4a4f2bb75cc413b. Resources: {'cores', 'instances', 'ram'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:57:57.388397 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-7c0ed744-8283-4668-983e-a6675bd515af tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Getting quotas for user 2c1462f97e2c45559a1592efcc0457ab and project 76512cf5f51b4bc9a4a4f2bb75cc413b. Resources: {'cores', 'instances', 'ram'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:57:57.405019 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-7c0ed744-8283-4668-983e-a6675bd515af tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Going to run 1 instances... {{(pid=124714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 16:57:57.408186 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-7c0ed744-8283-4668-983e-a6675bd515af tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] [instance: dfc0a4e9-9d6d-4889-bdf8-06127802a545] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96972e76-879d-4149-a713-a94529892aad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 16:57:57.450191 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-699b63d1-848c-4d94-af6c-3788cff10c0c tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:57.451612 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-699b63d1-848c-4d94-af6c-3788cff10c0c tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:57.463158 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-699b63d1-848c-4d94-af6c-3788cff10c0c tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:57.466232 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-699b63d1-848c-4d94-af6c-3788cff10c0c tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:57.467139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-699b63d1-848c-4d94-af6c-3788cff10c0c tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:57.472424 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-699b63d1-848c-4d94-af6c-3788cff10c0c tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:57.518552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-699b63d1-848c-4d94-af6c-3788cff10c0c tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:57.519426 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-699b63d1-848c-4d94-af6c-3788cff10c0c tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:57.520070 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.objects.instance [None req-699b63d1-848c-4d94-af6c-3788cff10c0c tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lazy-loading 'fault' on Instance uuid 5e461f9e-4217-45ec-bf28-2a70f7ca0f82 {{(pid=124715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:57:57.551621 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-7c0ed744-8283-4668-983e-a6675bd515af tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.651963 May 23 16:57:57.552919 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 476/975] 10.222.0.74 () {60 vars in 1146 bytes} [Mon May 23 16:57:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 16:57:57.567855 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-13cd9e8a-b30e-42fb-846a-0008e49c7c76 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:57.572852 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-13cd9e8a-b30e-42fb-846a-0008e49c7c76 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] [instance: dfc0a4e9-9d6d-4889-bdf8-06127802a545] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:57.636333 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-699b63d1-848c-4d94-af6c-3788cff10c0c tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:57.650194 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-699b63d1-848c-4d94-af6c-3788cff10c0c tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 200 len: 1184 microversion: 2.1 time: 0.207793 May 23 16:57:57.650785 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 500/976] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:57 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 1184 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:57:57.698122 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-13cd9e8a-b30e-42fb-846a-0008e49c7c76 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1462f97e2c45559a1592efcc0457ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76512cf5f51b4bc9a4a4f2bb75cc413b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:57.706444 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-13cd9e8a-b30e-42fb-846a-0008e49c7c76 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] 10.222.0.74 "GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545" status: 200 len: 1214 microversion: 2.1 time: 0.146121 May 23 16:57:57.709382 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 477/977] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:57 2022] GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545 => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:57:58.667718 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e32ef2c7-33be-483c-8e00-86ff4a7cfdfc tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:58.668363 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e32ef2c7-33be-483c-8e00-86ff4a7cfdfc tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:58.674801 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e32ef2c7-33be-483c-8e00-86ff4a7cfdfc tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:58.675601 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e32ef2c7-33be-483c-8e00-86ff4a7cfdfc tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:58.676626 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e32ef2c7-33be-483c-8e00-86ff4a7cfdfc tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:58.677268 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e32ef2c7-33be-483c-8e00-86ff4a7cfdfc tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:58.697733 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-e32ef2c7-33be-483c-8e00-86ff4a7cfdfc tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] HTTP exception thrown: Instance 5e461f9e-4217-45ec-bf28-2a70f7ca0f82 could not be found. May 23 16:57:58.699750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e32ef2c7-33be-483c-8e00-86ff4a7cfdfc tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Request method failure captured: May 23 16:57:58.699750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 HTTP/1.1 May 23 16:57:58.699750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:57:58.699750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:57:58.699750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:57:58.699750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:57:58.699750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:57:58.699750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:57:58.699750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:57:58.699750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:57:58.699750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7xBrV4MjFQh51j4dPvJWSwFpw9CUbC49y-llzMB8Abn5LWu0gl2XpNIPHXBBG8AW61v_eaHkKQumxXQe5ZAM2zmHFTjIw_fBD--b9MfK81l987usOgVabVAT5Uj5BFtUIWTwtdJGrJFRxvzrM5GVBHx1tt3O3LXuh_R-aV7OWRFItQ May 23 16:57:58.699750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:57:58.699750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:57:58.699750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:57:58.699750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:57:58.699750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:57:58.699750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:57:58.699750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: 8d09d9819e564152aacc661d1da68fcd May 23 16:57:58.699750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-TestVolumeBootPattern-528381394 May 23 16:57:58.699750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:57:58.699750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:57:58.702802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8d09d9819e564152aacc661d1da68fcd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8d09d9819e564152aacc661d1da68fcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8d09d9819e564152aacc661d1da68fcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8d09d9819e564152aacc661d1da68fcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:57:58.702802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-TestVolumeBootPattern-528381394 May 23 16:57:58.702802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: 8d09d9819e564152aacc661d1da68fcd May 23 16:57:58.702802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-TestVolumeBootPattern-528381394 May 23 16:57:58.702802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-TestVolumeBootPattern-528381394-project May 23 16:57:58.702802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:57:58.702802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:57:58.702802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: 2aa01ac54736475188dbc47f3cda4de1 May 23 16:57:58.702802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-TestVolumeBootPattern-528381394-project May 23 16:57:58.702802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 16:57:58.702802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Instance 5e461f9e-4217-45ec-bf28-2a70f7ca0f82 could not be found. May 23 16:57:58.702802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': '5e461f9e-4217-45ec-bf28-2a70f7ca0f82'} May 23 16:57:58.703755 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:57:58.703755 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:57:58.703755 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:57:58.703755 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:57:58.703755 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:57:58.703755 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:57:58.703755 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:57:58.703755 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:57:58.703755 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:57:58.703755 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:57:58.703755 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e461f9e-4217-45ec-bf28-2a70f7ca0f82 could not be found. May 23 16:57:58.703755 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:57:58.703755 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:57:58.703755 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:57:58.703755 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:57:58.703755 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:57:58.703755 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:57:58.703755 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:57:58.703755 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:57:58.703755 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:57:58.716171 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:57:58.716171 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:57:58.716171 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:57:58.716171 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:57:58.716171 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:57:58.716171 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:57:58.716171 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:57:58.716171 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e461f9e-4217-45ec-bf28-2a70f7ca0f82 could not be found. May 23 16:57:58.716171 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:57:58.716171 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:57:58.716171 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:57:58.716171 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:57:58.716171 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:57:58.716171 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:57:58.716171 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:57:58.716171 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:57:58.716171 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e461f9e-4217-45ec-bf28-2a70f7ca0f82 could not be found. May 23 16:57:58.716171 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:57:58.717466 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e32ef2c7-33be-483c-8e00-86ff4a7cfdfc tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Returning 404 to user: Instance 5e461f9e-4217-45ec-bf28-2a70f7ca0f82 could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:57:58.717466 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e32ef2c7-33be-483c-8e00-86ff4a7cfdfc tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 404 len: 111 microversion: 2.1 time: 0.038116 May 23 16:57:58.717466 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 501/978] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:58 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:57:58.723387 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-136f2bd2-7c68-4f0d-a7b5-75fd3cb60c7d tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:58.724369 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-136f2bd2-7c68-4f0d-a7b5-75fd3cb60c7d tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] [instance: dfc0a4e9-9d6d-4889-bdf8-06127802a545] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:58.835536 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-136f2bd2-7c68-4f0d-a7b5-75fd3cb60c7d tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1462f97e2c45559a1592efcc0457ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76512cf5f51b4bc9a4a4f2bb75cc413b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:58.849104 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-136f2bd2-7c68-4f0d-a7b5-75fd3cb60c7d tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] 10.222.0.74 "GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545" status: 200 len: 1214 microversion: 2.1 time: 0.124150 May 23 16:57:58.849376 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 478/979] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:58 2022] GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545 => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:57:58.859992 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-96d53b3a-fbbd-4317-ae4b-c0addf0eedb7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-99074200", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-877096425", "security_groups": [{"name": "tempest-secgroup-smoke-1810518830"}], "block_device_mapping_v2": [{"uuid": "906509eb-7430-45a0-9d8e-d762e5df47e3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "919d5a7a-cf43-4ee4-a633-f9112228c533"}]}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:57:58.999066 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.network.neutron [None req-96d53b3a-fbbd-4317-ae4b-c0addf0eedb7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] validate_networks() for [('919d5a7a-cf43-4ee4-a633-f9112228c533', None, None, None, None, None)] {{(pid=124715) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 16:57:59.756591 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-96d53b3a-fbbd-4317-ae4b-c0addf0eedb7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Flavor limits 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 16:57:59.756591 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-96d53b3a-fbbd-4317-ae4b-c0addf0eedb7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Image limits 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 16:57:59.756591 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-96d53b3a-fbbd-4317-ae4b-c0addf0eedb7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Flavor pref 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 16:57:59.757313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-96d53b3a-fbbd-4317-ae4b-c0addf0eedb7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Image pref 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 16:57:59.757313 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-96d53b3a-fbbd-4317-ae4b-c0addf0eedb7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 16:57:59.766196 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-96d53b3a-fbbd-4317-ae4b-c0addf0eedb7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:59.766583 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-96d53b3a-fbbd-4317-ae4b-c0addf0eedb7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:59.767375 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-96d53b3a-fbbd-4317-ae4b-c0addf0eedb7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:59.767828 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-96d53b3a-fbbd-4317-ae4b-c0addf0eedb7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:59.791047 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-96d53b3a-fbbd-4317-ae4b-c0addf0eedb7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Getting quotas for project 8d09d9819e564152aacc661d1da68fcd. Resources: {'cores', 'instances', 'ram'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:57:59.797134 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-96d53b3a-fbbd-4317-ae4b-c0addf0eedb7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Getting quotas for user 2aa01ac54736475188dbc47f3cda4de1 and project 8d09d9819e564152aacc661d1da68fcd. Resources: {'cores', 'instances', 'ram'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:57:59.861856 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-96d53b3a-fbbd-4317-ae4b-c0addf0eedb7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Going to run 1 instances... {{(pid=124715) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 16:57:59.864154 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-96d53b3a-fbbd-4317-ae4b-c0addf0eedb7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='906509eb-7430-45a0-9d8e-d762e5df47e3',volume_size=None,volume_type=None)] {{(pid=124715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 16:57:59.864407 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-3834f162-0d4a-409c-a155-5c2bacd17997 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:57:59.865736 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-3834f162-0d4a-409c-a155-5c2bacd17997 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] [instance: dfc0a4e9-9d6d-4889-bdf8-06127802a545] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:57:59.876240 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3834f162-0d4a-409c-a155-5c2bacd17997 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:59.877596 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3834f162-0d4a-409c-a155-5c2bacd17997 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:59.878573 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3834f162-0d4a-409c-a155-5c2bacd17997 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:57:59.879156 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3834f162-0d4a-409c-a155-5c2bacd17997 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:57:59.955369 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-3834f162-0d4a-409c-a155-5c2bacd17997 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1462f97e2c45559a1592efcc0457ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76512cf5f51b4bc9a4a4f2bb75cc413b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:57:59.964722 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-3834f162-0d4a-409c-a155-5c2bacd17997 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] 10.222.0.74 "GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545" status: 200 len: 1266 microversion: 2.1 time: 0.107333 May 23 16:57:59.965307 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 479/980] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:57:59 2022] GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:00.377603 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-96d53b3a-fbbd-4317-ae4b-c0addf0eedb7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.521534 May 23 16:58:00.379009 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 502/981] 10.222.0.74 () {60 vars in 1146 bytes} [Mon May 23 16:57:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 16:58:00.394298 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-33553fba-8e6c-42b9-82b4-042a9e3c64ca tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:00.398709 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-33553fba-8e6c-42b9-82b4-042a9e3c64ca tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:00.470354 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-33553fba-8e6c-42b9-82b4-042a9e3c64ca tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:00.479777 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-33553fba-8e6c-42b9-82b4-042a9e3c64ca tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 200 len: 1092 microversion: 2.1 time: 0.094340 May 23 16:58:00.480646 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 480/982] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:00 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 1092 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:00.982512 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-0d46e734-7bcc-4814-a65c-39d29fa68ecf tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:00.983199 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-0d46e734-7bcc-4814-a65c-39d29fa68ecf tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] [instance: dfc0a4e9-9d6d-4889-bdf8-06127802a545] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:00.994965 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0d46e734-7bcc-4814-a65c-39d29fa68ecf tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:00.995434 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0d46e734-7bcc-4814-a65c-39d29fa68ecf tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:00.996851 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0d46e734-7bcc-4814-a65c-39d29fa68ecf tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:00.997576 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0d46e734-7bcc-4814-a65c-39d29fa68ecf tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:01.092210 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-0d46e734-7bcc-4814-a65c-39d29fa68ecf tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1462f97e2c45559a1592efcc0457ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76512cf5f51b4bc9a4a4f2bb75cc413b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:01.100061 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-0d46e734-7bcc-4814-a65c-39d29fa68ecf tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] 10.222.0.74 "GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545" status: 200 len: 1272 microversion: 2.1 time: 0.121911 May 23 16:58:01.101089 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 503/983] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:00 2022] GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545 => generated 1272 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:01.500468 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-e4fd8750-ab87-4211-86d7-d1afc66246dd tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:01.501909 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-e4fd8750-ab87-4211-86d7-d1afc66246dd tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:01.511351 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e4fd8750-ab87-4211-86d7-d1afc66246dd tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:01.512184 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e4fd8750-ab87-4211-86d7-d1afc66246dd tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:01.513457 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e4fd8750-ab87-4211-86d7-d1afc66246dd tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:01.514178 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e4fd8750-ab87-4211-86d7-d1afc66246dd tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:01.669943 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e4fd8750-ab87-4211-86d7-d1afc66246dd tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:01.689739 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-e4fd8750-ab87-4211-86d7-d1afc66246dd tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 200 len: 1142 microversion: 2.1 time: 0.195154 May 23 16:58:01.691264 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 481/984] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:01 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 1142 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:02.118030 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-fffd6790-9906-4697-a467-075c30547128 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:02.118886 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-fffd6790-9906-4697-a467-075c30547128 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] [instance: dfc0a4e9-9d6d-4889-bdf8-06127802a545] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:02.128589 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fffd6790-9906-4697-a467-075c30547128 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:02.129233 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fffd6790-9906-4697-a467-075c30547128 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:02.130201 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fffd6790-9906-4697-a467-075c30547128 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:02.130697 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fffd6790-9906-4697-a467-075c30547128 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:02.415704 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-fffd6790-9906-4697-a467-075c30547128 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1462f97e2c45559a1592efcc0457ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76512cf5f51b4bc9a4a4f2bb75cc413b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:02.432613 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-fffd6790-9906-4697-a467-075c30547128 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] 10.222.0.74 "GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545" status: 200 len: 1314 microversion: 2.1 time: 0.318673 May 23 16:58:02.446874 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 504/985] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:02 2022] GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:58:02.708091 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-fab5f674-0c11-4f10-a531-7458329b2367 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:02.710468 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-fab5f674-0c11-4f10-a531-7458329b2367 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:02.734325 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fab5f674-0c11-4f10-a531-7458329b2367 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:02.734779 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fab5f674-0c11-4f10-a531-7458329b2367 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:02.739995 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fab5f674-0c11-4f10-a531-7458329b2367 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:02.748186 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-ee79e5a1-36b1-4c66-b192-17ce78aa21bc req-d48263ef-bd4f-45c6-a01e-36e453808fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfc0a4e9-9d6d-4889-bdf8-06127802a545", "tag": "05b235f2-71f9-452c-8a1e-d8fca8d5184f"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:58:02.753868 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fab5f674-0c11-4f10-a531-7458329b2367 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:02.770546 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-ee79e5a1-36b1-4c66-b192-17ce78aa21bc req-d48263ef-bd4f-45c6-a01e-36e453808fa8 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:02.775346 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-ee79e5a1-36b1-4c66-b192-17ce78aa21bc req-d48263ef-bd4f-45c6-a01e-36e453808fa8 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:02.816866 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-ee79e5a1-36b1-4c66-b192-17ce78aa21bc req-d48263ef-bd4f-45c6-a01e-36e453808fa8 service nova] Creating event network-changed:05b235f2-71f9-452c-8a1e-d8fca8d5184f for instance dfc0a4e9-9d6d-4889-bdf8-06127802a545 on hv-cinder-83925 May 23 16:58:02.841364 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-ee79e5a1-36b1-4c66-b192-17ce78aa21bc req-d48263ef-bd4f-45c6-a01e-36e453808fa8 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096891 May 23 16:58:02.847216 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 505/986] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:58:02.971325 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-fab5f674-0c11-4f10-a531-7458329b2367 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:02.979319 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-fab5f674-0c11-4f10-a531-7458329b2367 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 200 len: 1190 microversion: 2.1 time: 0.275522 May 23 16:58:02.988189 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 482/987] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:02 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 1190 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:03.458795 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-d5d47688-1e4b-4682-abbd-311ce4b12c72 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:03.458795 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-d5d47688-1e4b-4682-abbd-311ce4b12c72 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] [instance: dfc0a4e9-9d6d-4889-bdf8-06127802a545] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:03.473669 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d5d47688-1e4b-4682-abbd-311ce4b12c72 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:03.474139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d5d47688-1e4b-4682-abbd-311ce4b12c72 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:03.478436 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d5d47688-1e4b-4682-abbd-311ce4b12c72 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:03.478901 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d5d47688-1e4b-4682-abbd-311ce4b12c72 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:03.759226 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d5d47688-1e4b-4682-abbd-311ce4b12c72 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1462f97e2c45559a1592efcc0457ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76512cf5f51b4bc9a4a4f2bb75cc413b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:03.767497 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-d5d47688-1e4b-4682-abbd-311ce4b12c72 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] 10.222.0.74 "GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545" status: 200 len: 1314 microversion: 2.1 time: 0.319110 May 23 16:58:03.768083 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 506/988] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:03 2022] GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:04.005651 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-298dd5a0-35fb-4119-85b2-310e63f21d48 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:04.007625 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-298dd5a0-35fb-4119-85b2-310e63f21d48 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:04.017105 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-298dd5a0-35fb-4119-85b2-310e63f21d48 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:04.017953 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-298dd5a0-35fb-4119-85b2-310e63f21d48 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:04.020045 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-298dd5a0-35fb-4119-85b2-310e63f21d48 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:04.020716 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-298dd5a0-35fb-4119-85b2-310e63f21d48 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:04.141910 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-298dd5a0-35fb-4119-85b2-310e63f21d48 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:04.155193 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-298dd5a0-35fb-4119-85b2-310e63f21d48 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 200 len: 1208 microversion: 2.1 time: 0.153559 May 23 16:58:04.156452 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 483/989] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:04 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 1208 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:04.786202 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-200f88b3-f1b8-450f-b5c3-705c27d43d53 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:04.787588 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-200f88b3-f1b8-450f-b5c3-705c27d43d53 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] [instance: dfc0a4e9-9d6d-4889-bdf8-06127802a545] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:04.799768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-200f88b3-f1b8-450f-b5c3-705c27d43d53 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:04.801066 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-200f88b3-f1b8-450f-b5c3-705c27d43d53 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:04.802070 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-200f88b3-f1b8-450f-b5c3-705c27d43d53 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:04.802895 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-200f88b3-f1b8-450f-b5c3-705c27d43d53 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:04.995040 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-200f88b3-f1b8-450f-b5c3-705c27d43d53 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1462f97e2c45559a1592efcc0457ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76512cf5f51b4bc9a4a4f2bb75cc413b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:05.003265 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-200f88b3-f1b8-450f-b5c3-705c27d43d53 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] 10.222.0.74 "GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545" status: 200 len: 1314 microversion: 2.1 time: 0.221153 May 23 16:58:05.003842 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 507/990] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:04 2022] GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:05.172512 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-32e00b49-7aaf-4826-b9ae-61d5596d822a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:05.173795 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-32e00b49-7aaf-4826-b9ae-61d5596d822a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:05.184820 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-32e00b49-7aaf-4826-b9ae-61d5596d822a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:05.186369 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-32e00b49-7aaf-4826-b9ae-61d5596d822a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:05.187757 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-32e00b49-7aaf-4826-b9ae-61d5596d822a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:05.188390 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-32e00b49-7aaf-4826-b9ae-61d5596d822a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:05.364854 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-32e00b49-7aaf-4826-b9ae-61d5596d822a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:05.374092 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-32e00b49-7aaf-4826-b9ae-61d5596d822a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 200 len: 1276 microversion: 2.1 time: 0.205895 May 23 16:58:05.376227 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 484/991] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:05 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 1276 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:06.021138 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-68e7cfea-07bd-49be-9e22-9bd23a121733 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:06.022094 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-68e7cfea-07bd-49be-9e22-9bd23a121733 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] [instance: dfc0a4e9-9d6d-4889-bdf8-06127802a545] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:06.029436 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-68e7cfea-07bd-49be-9e22-9bd23a121733 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:06.030035 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-68e7cfea-07bd-49be-9e22-9bd23a121733 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:06.030840 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-68e7cfea-07bd-49be-9e22-9bd23a121733 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:06.031287 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-68e7cfea-07bd-49be-9e22-9bd23a121733 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:06.175885 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-68e7cfea-07bd-49be-9e22-9bd23a121733 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1462f97e2c45559a1592efcc0457ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76512cf5f51b4bc9a4a4f2bb75cc413b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:06.184368 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-68e7cfea-07bd-49be-9e22-9bd23a121733 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] 10.222.0.74 "GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545" status: 200 len: 1314 microversion: 2.1 time: 0.167101 May 23 16:58:06.185132 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 508/992] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:06 2022] GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:06.393961 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-8b9ead7c-9774-4778-8144-a8cd66f80357 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:06.395380 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-8b9ead7c-9774-4778-8144-a8cd66f80357 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:06.404048 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8b9ead7c-9774-4778-8144-a8cd66f80357 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:06.404828 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8b9ead7c-9774-4778-8144-a8cd66f80357 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:06.406167 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8b9ead7c-9774-4778-8144-a8cd66f80357 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:06.407037 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8b9ead7c-9774-4778-8144-a8cd66f80357 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:06.637471 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8b9ead7c-9774-4778-8144-a8cd66f80357 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:06.647784 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-8b9ead7c-9774-4778-8144-a8cd66f80357 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 200 len: 1276 microversion: 2.1 time: 0.259029 May 23 16:58:06.660195 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 485/993] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:06 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 1276 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:07.173869 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-69d07cae-4dd9-4d65-8da9-9a1064957da8 req-9ceeab7a-7386-4685-a7f5-1d0200c53bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d1af3a9-42b0-46e8-8c63-55256f645d1a", "tag": "5875fa7e-540a-4b73-b6a6-d251f8408804"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:58:07.192336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-69d07cae-4dd9-4d65-8da9-9a1064957da8 req-9ceeab7a-7386-4685-a7f5-1d0200c53bb6 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:07.192809 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-69d07cae-4dd9-4d65-8da9-9a1064957da8 req-9ceeab7a-7386-4685-a7f5-1d0200c53bb6 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:07.202063 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-9a0f3456-8805-482a-a0fd-c1ae4ac354d6 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:07.203633 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-9a0f3456-8805-482a-a0fd-c1ae4ac354d6 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] [instance: dfc0a4e9-9d6d-4889-bdf8-06127802a545] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:07.213849 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-69d07cae-4dd9-4d65-8da9-9a1064957da8 req-9ceeab7a-7386-4685-a7f5-1d0200c53bb6 service nova] Creating event network-changed:5875fa7e-540a-4b73-b6a6-d251f8408804 for instance 8d1af3a9-42b0-46e8-8c63-55256f645d1a on hv-cinder-83925 May 23 16:58:07.220644 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-69d07cae-4dd9-4d65-8da9-9a1064957da8 req-9ceeab7a-7386-4685-a7f5-1d0200c53bb6 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051377 May 23 16:58:07.222331 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 509/994] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:58:07.223953 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9a0f3456-8805-482a-a0fd-c1ae4ac354d6 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:07.224458 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9a0f3456-8805-482a-a0fd-c1ae4ac354d6 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:07.225213 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9a0f3456-8805-482a-a0fd-c1ae4ac354d6 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:07.225656 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9a0f3456-8805-482a-a0fd-c1ae4ac354d6 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:07.367786 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=2 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:07.517679 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-9a0f3456-8805-482a-a0fd-c1ae4ac354d6 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1462f97e2c45559a1592efcc0457ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76512cf5f51b4bc9a4a4f2bb75cc413b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:07.529207 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-9a0f3456-8805-482a-a0fd-c1ae4ac354d6 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] 10.222.0.74 "GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545" status: 200 len: 1314 microversion: 2.1 time: 0.331307 May 23 16:58:07.537956 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 486/995] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:07 2022] GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:07.667922 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-032f732e-1e06-4e2d-8f4f-8f4331c77198 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:07.668677 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-032f732e-1e06-4e2d-8f4f-8f4331c77198 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:07.682125 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-032f732e-1e06-4e2d-8f4f-8f4331c77198 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:07.682594 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-032f732e-1e06-4e2d-8f4f-8f4331c77198 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:07.683600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-032f732e-1e06-4e2d-8f4f-8f4331c77198 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:07.684052 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-032f732e-1e06-4e2d-8f4f-8f4331c77198 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:08.007334 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-032f732e-1e06-4e2d-8f4f-8f4331c77198 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:08.018759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-032f732e-1e06-4e2d-8f4f-8f4331c77198 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 200 len: 1264 microversion: 2.1 time: 0.355369 May 23 16:58:08.019705 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 510/996] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:07 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 1264 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:08.321640 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-5b4f812b-7249-4a89-a045-78c429094043 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Action: 'create', calling method: .version_select at 0x7f224c643dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-312995941", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1irbaTRWUdLFmczvy+nJmM46Nr6Gj4qx7gF3gqA8ZMwoWgSWIKowHsUjZZUMXKUQeYqkPGBmMLWuQQJu+646T1yyJaoOe1/twNzfBEtt1SWjz2D8DSawyRpLihnF9aDw=="}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:58:08.337348 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-5b4f812b-7249-4a89-a045-78c429094043 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Getting quotas for project 6ae6212e50a1473a91e3abcff84f6f9b. Resources: {'key_pairs'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:58:08.341487 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-5b4f812b-7249-4a89-a045-78c429094043 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Getting quotas for user 43e80a38a048456ba61ce41648475374 and project 6ae6212e50a1473a91e3abcff84f6f9b. Resources: {'key_pairs'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:58:08.442713 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-5b4f812b-7249-4a89-a045-78c429094043 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.328602 May 23 16:58:08.443327 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 487/997] 10.222.0.74 () {60 vars in 1158 bytes} [Mon May 23 16:58:08 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:58:08.547930 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-3e14255d-3c5f-4d00-8bf4-c079bd40d844 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:08.548622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-3e14255d-3c5f-4d00-8bf4-c079bd40d844 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] [instance: dfc0a4e9-9d6d-4889-bdf8-06127802a545] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:08.555593 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3e14255d-3c5f-4d00-8bf4-c079bd40d844 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:08.556051 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3e14255d-3c5f-4d00-8bf4-c079bd40d844 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:08.558376 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3e14255d-3c5f-4d00-8bf4-c079bd40d844 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:08.558376 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3e14255d-3c5f-4d00-8bf4-c079bd40d844 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:08.749774 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-3e14255d-3c5f-4d00-8bf4-c079bd40d844 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1462f97e2c45559a1592efcc0457ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76512cf5f51b4bc9a4a4f2bb75cc413b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:08.753905 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-3e14255d-3c5f-4d00-8bf4-c079bd40d844 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] 10.222.0.74 "GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545" status: 200 len: 1314 microversion: 2.1 time: 0.210042 May 23 16:58:08.754715 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 511/998] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:08 2022] GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:08.938998 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-a1805ed7-a2b1-4c92-8742-0a46503088bc req-1ae88c76-674f-4868-a4ca-3aa0ebdb8d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc0a4e9-9d6d-4889-bdf8-06127802a545", "name": "network-vif-plugged", "status": "completed", "tag": "05b235f2-71f9-452c-8a1e-d8fca8d5184f"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:58:08.948417 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-a1805ed7-a2b1-4c92-8742-0a46503088bc req-1ae88c76-674f-4868-a4ca-3aa0ebdb8d6f service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:08.948865 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-a1805ed7-a2b1-4c92-8742-0a46503088bc req-1ae88c76-674f-4868-a4ca-3aa0ebdb8d6f service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:08.959772 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-a1805ed7-a2b1-4c92-8742-0a46503088bc req-1ae88c76-674f-4868-a4ca-3aa0ebdb8d6f service nova] Creating event network-vif-plugged:05b235f2-71f9-452c-8a1e-d8fca8d5184f for instance dfc0a4e9-9d6d-4889-bdf8-06127802a545 on hv-cinder-83925 May 23 16:58:08.964951 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-a1805ed7-a2b1-4c92-8742-0a46503088bc req-1ae88c76-674f-4868-a4ca-3aa0ebdb8d6f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029723 May 23 16:58:08.969501 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 488/999] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:58:09.036910 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-563f4983-3a1b-4b40-8bf6-789410a722ba tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:09.037536 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-563f4983-3a1b-4b40-8bf6-789410a722ba tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:09.044238 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-563f4983-3a1b-4b40-8bf6-789410a722ba tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:09.044705 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-563f4983-3a1b-4b40-8bf6-789410a722ba tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:09.045485 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-563f4983-3a1b-4b40-8bf6-789410a722ba tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:09.045929 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-563f4983-3a1b-4b40-8bf6-789410a722ba tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:09.184537 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-563f4983-3a1b-4b40-8bf6-789410a722ba tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:09.192501 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-563f4983-3a1b-4b40-8bf6-789410a722ba tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 200 len: 1264 microversion: 2.1 time: 0.159281 May 23 16:58:09.193224 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 512/1000] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:09 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:09.771992 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-b6ab3445-19f1-4402-aad2-8cd52c185db4 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:09.772764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-b6ab3445-19f1-4402-aad2-8cd52c185db4 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] [instance: dfc0a4e9-9d6d-4889-bdf8-06127802a545] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:09.779831 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b6ab3445-19f1-4402-aad2-8cd52c185db4 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:09.780281 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b6ab3445-19f1-4402-aad2-8cd52c185db4 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:09.781071 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b6ab3445-19f1-4402-aad2-8cd52c185db4 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:09.781518 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b6ab3445-19f1-4402-aad2-8cd52c185db4 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:09.912276 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b6ab3445-19f1-4402-aad2-8cd52c185db4 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1462f97e2c45559a1592efcc0457ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76512cf5f51b4bc9a4a4f2bb75cc413b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:09.922433 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-b6ab3445-19f1-4402-aad2-8cd52c185db4 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] 10.222.0.74 "GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545" status: 200 len: 1314 microversion: 2.1 time: 0.155046 May 23 16:58:09.923270 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 489/1001] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:09 2022] GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:10.207278 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=2 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:10.208100 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=6 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:10.212781 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-275ea8c5-a2b7-4abd-abe0-7b5945a632b0 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:10.213618 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-275ea8c5-a2b7-4abd-abe0-7b5945a632b0 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:10.220103 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-275ea8c5-a2b7-4abd-abe0-7b5945a632b0 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:10.220594 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-275ea8c5-a2b7-4abd-abe0-7b5945a632b0 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:10.221369 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-275ea8c5-a2b7-4abd-abe0-7b5945a632b0 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:10.221816 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-275ea8c5-a2b7-4abd-abe0-7b5945a632b0 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:10.371359 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-275ea8c5-a2b7-4abd-abe0-7b5945a632b0 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:10.379001 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-275ea8c5-a2b7-4abd-abe0-7b5945a632b0 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 200 len: 1264 microversion: 2.1 time: 0.173082 May 23 16:58:10.379570 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 513/1002] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:10 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:10.943430 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-3fff389a-8684-42d7-9a4e-2563ae1ecb77 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:10.944087 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-3fff389a-8684-42d7-9a4e-2563ae1ecb77 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] [instance: dfc0a4e9-9d6d-4889-bdf8-06127802a545] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:10.951089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3fff389a-8684-42d7-9a4e-2563ae1ecb77 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:10.951546 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3fff389a-8684-42d7-9a4e-2563ae1ecb77 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:10.952422 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3fff389a-8684-42d7-9a4e-2563ae1ecb77 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:10.952868 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3fff389a-8684-42d7-9a4e-2563ae1ecb77 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:11.113801 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-3fff389a-8684-42d7-9a4e-2563ae1ecb77 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1462f97e2c45559a1592efcc0457ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76512cf5f51b4bc9a4a4f2bb75cc413b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:11.123938 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-3fff389a-8684-42d7-9a4e-2563ae1ecb77 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] 10.222.0.74 "GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545" status: 200 len: 1314 microversion: 2.1 time: 0.187679 May 23 16:58:11.126267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 490/1003] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:10 2022] GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:11.396934 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-6dac26c0-9223-485a-bfce-a03674caf8ae tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:11.397552 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-6dac26c0-9223-485a-bfce-a03674caf8ae tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:11.404217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6dac26c0-9223-485a-bfce-a03674caf8ae tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:11.404737 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6dac26c0-9223-485a-bfce-a03674caf8ae tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:11.405540 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6dac26c0-9223-485a-bfce-a03674caf8ae tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:11.405985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6dac26c0-9223-485a-bfce-a03674caf8ae tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:11.552055 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-6dac26c0-9223-485a-bfce-a03674caf8ae tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:11.560797 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-6dac26c0-9223-485a-bfce-a03674caf8ae tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 200 len: 1264 microversion: 2.1 time: 0.167654 May 23 16:58:11.562839 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 514/1004] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:11 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:12.143056 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-7c59fefd-ff4a-4855-84ee-ca5a65e98801 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:12.143651 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-7c59fefd-ff4a-4855-84ee-ca5a65e98801 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] [instance: dfc0a4e9-9d6d-4889-bdf8-06127802a545] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:12.150897 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7c59fefd-ff4a-4855-84ee-ca5a65e98801 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:12.151600 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7c59fefd-ff4a-4855-84ee-ca5a65e98801 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:12.152117 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7c59fefd-ff4a-4855-84ee-ca5a65e98801 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:12.152722 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7c59fefd-ff4a-4855-84ee-ca5a65e98801 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:12.340125 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7c59fefd-ff4a-4855-84ee-ca5a65e98801 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1462f97e2c45559a1592efcc0457ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76512cf5f51b4bc9a4a4f2bb75cc413b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:12.350223 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-7c59fefd-ff4a-4855-84ee-ca5a65e98801 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] 10.222.0.74 "GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545" status: 200 len: 1463 microversion: 2.1 time: 0.211129 May 23 16:58:12.353580 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 491/1005] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:12 2022] GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545 => generated 1463 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:58:12.398595 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-81c792de-c4c9-467a-ab31-af02c6d1f4d1 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:12.399804 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-81c792de-c4c9-467a-ab31-af02c6d1f4d1 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] [instance: dfc0a4e9-9d6d-4889-bdf8-06127802a545] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:12.406535 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-81c792de-c4c9-467a-ab31-af02c6d1f4d1 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:12.407275 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-81c792de-c4c9-467a-ab31-af02c6d1f4d1 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:12.408337 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-81c792de-c4c9-467a-ab31-af02c6d1f4d1 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:12.408970 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-81c792de-c4c9-467a-ab31-af02c6d1f4d1 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:12.446971 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-81c792de-c4c9-467a-ab31-af02c6d1f4d1 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] [instance: dfc0a4e9-9d6d-4889-bdf8-06127802a545] Going to try to terminate instance {{(pid=124715) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 16:58:12.451695 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=100 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:12.580122 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-599f408c-cc28-439b-9b24-6b8a35bb5c3d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:12.581037 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-599f408c-cc28-439b-9b24-6b8a35bb5c3d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:12.588507 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-599f408c-cc28-439b-9b24-6b8a35bb5c3d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:12.588957 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-599f408c-cc28-439b-9b24-6b8a35bb5c3d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:12.589732 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-599f408c-cc28-439b-9b24-6b8a35bb5c3d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:12.590167 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-599f408c-cc28-439b-9b24-6b8a35bb5c3d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:12.766400 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-599f408c-cc28-439b-9b24-6b8a35bb5c3d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:12.772106 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-81c792de-c4c9-467a-ab31-af02c6d1f4d1 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] 10.222.0.74 "DELETE /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545" status: 204 len: 0 microversion: 2.1 time: 0.377871 May 23 16:58:12.774968 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 515/1006] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 16:58:12 2022] DELETE /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 16:58:12.776587 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-599f408c-cc28-439b-9b24-6b8a35bb5c3d tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 200 len: 1264 microversion: 2.1 time: 0.202184 May 23 16:58:12.778235 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 492/1007] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:12 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 1264 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:58:12.786628 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-34f29a86-cdaf-49fc-a921-29ef3139ac3f tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:12.787558 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-34f29a86-cdaf-49fc-a921-29ef3139ac3f tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] [instance: dfc0a4e9-9d6d-4889-bdf8-06127802a545] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:12.798106 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-34f29a86-cdaf-49fc-a921-29ef3139ac3f tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:12.798686 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-34f29a86-cdaf-49fc-a921-29ef3139ac3f tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:12.799828 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-34f29a86-cdaf-49fc-a921-29ef3139ac3f tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:12.800391 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-34f29a86-cdaf-49fc-a921-29ef3139ac3f tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:12.980560 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-34f29a86-cdaf-49fc-a921-29ef3139ac3f tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1462f97e2c45559a1592efcc0457ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76512cf5f51b4bc9a4a4f2bb75cc413b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:12.990346 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-34f29a86-cdaf-49fc-a921-29ef3139ac3f tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] 10.222.0.74 "GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545" status: 200 len: 1469 microversion: 2.1 time: 0.208408 May 23 16:58:12.990931 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 516/1008] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:12 2022] GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545 => generated 1469 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:13.795742 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-8ae63a20-8ddf-4791-9c08-24807c068363 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:13.796374 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-8ae63a20-8ddf-4791-9c08-24807c068363 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:13.803620 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8ae63a20-8ddf-4791-9c08-24807c068363 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:13.804242 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8ae63a20-8ddf-4791-9c08-24807c068363 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:13.805170 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8ae63a20-8ddf-4791-9c08-24807c068363 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:13.805624 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8ae63a20-8ddf-4791-9c08-24807c068363 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:13.942289 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8ae63a20-8ddf-4791-9c08-24807c068363 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:13.945960 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:13.950226 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-8ae63a20-8ddf-4791-9c08-24807c068363 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 200 len: 1264 microversion: 2.1 time: 0.158326 May 23 16:58:13.950791 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 493/1009] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:13 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:14.008244 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-09e24f90-6329-41b1-bf15-c253c7ff2475 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:14.008883 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-09e24f90-6329-41b1-bf15-c253c7ff2475 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] [instance: dfc0a4e9-9d6d-4889-bdf8-06127802a545] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:14.015422 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-09e24f90-6329-41b1-bf15-c253c7ff2475 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:14.015874 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-09e24f90-6329-41b1-bf15-c253c7ff2475 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:14.016682 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-09e24f90-6329-41b1-bf15-c253c7ff2475 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:14.017153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-09e24f90-6329-41b1-bf15-c253c7ff2475 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:14.156945 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-09e24f90-6329-41b1-bf15-c253c7ff2475 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1462f97e2c45559a1592efcc0457ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76512cf5f51b4bc9a4a4f2bb75cc413b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:14.164463 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-09e24f90-6329-41b1-bf15-c253c7ff2475 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] 10.222.0.74 "GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545" status: 200 len: 1469 microversion: 2.1 time: 0.160200 May 23 16:58:14.165022 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 517/1010] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:14 2022] GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545 => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:14.968017 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-50e9ae64-2f32-4765-ad22-b627aaebf6c9 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:14.968746 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-50e9ae64-2f32-4765-ad22-b627aaebf6c9 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:14.976141 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-50e9ae64-2f32-4765-ad22-b627aaebf6c9 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:14.980229 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-50e9ae64-2f32-4765-ad22-b627aaebf6c9 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:14.980229 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-50e9ae64-2f32-4765-ad22-b627aaebf6c9 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:14.980229 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-50e9ae64-2f32-4765-ad22-b627aaebf6c9 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:15.123996 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-50e9ae64-2f32-4765-ad22-b627aaebf6c9 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:15.128917 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-50e9ae64-2f32-4765-ad22-b627aaebf6c9 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 200 len: 1264 microversion: 2.1 time: 0.164970 May 23 16:58:15.132811 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 494/1011] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:14 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:15.182076 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-0865f657-006d-4815-8007-5701c33cf836 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:15.182730 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-0865f657-006d-4815-8007-5701c33cf836 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] [instance: dfc0a4e9-9d6d-4889-bdf8-06127802a545] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:15.189579 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0865f657-006d-4815-8007-5701c33cf836 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:15.190033 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0865f657-006d-4815-8007-5701c33cf836 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:15.190843 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0865f657-006d-4815-8007-5701c33cf836 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:15.191284 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0865f657-006d-4815-8007-5701c33cf836 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:15.324599 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-0865f657-006d-4815-8007-5701c33cf836 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1462f97e2c45559a1592efcc0457ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76512cf5f51b4bc9a4a4f2bb75cc413b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:15.332561 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-0865f657-006d-4815-8007-5701c33cf836 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] 10.222.0.74 "GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545" status: 200 len: 1469 microversion: 2.1 time: 0.155053 May 23 16:58:15.333338 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 518/1012] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:15 2022] GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545 => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:15.877705 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-40245ee2-5c68-4cea-bb72-69acb355f5ba req-3107d405-a48e-4dc5-823f-ab631d1637b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc0a4e9-9d6d-4889-bdf8-06127802a545", "name": "network-vif-deleted", "tag": "05b235f2-71f9-452c-8a1e-d8fca8d5184f"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:58:15.886095 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-40245ee2-5c68-4cea-bb72-69acb355f5ba req-3107d405-a48e-4dc5-823f-ab631d1637b7 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:15.886544 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-40245ee2-5c68-4cea-bb72-69acb355f5ba req-3107d405-a48e-4dc5-823f-ab631d1637b7 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:15.898739 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-40245ee2-5c68-4cea-bb72-69acb355f5ba req-3107d405-a48e-4dc5-823f-ab631d1637b7 service nova] Creating event network-vif-deleted:05b235f2-71f9-452c-8a1e-d8fca8d5184f for instance dfc0a4e9-9d6d-4889-bdf8-06127802a545 on hv-cinder-83925 May 23 16:58:15.905640 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-40245ee2-5c68-4cea-bb72-69acb355f5ba req-3107d405-a48e-4dc5-823f-ab631d1637b7 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031569 May 23 16:58:15.906734 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 495/1013] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:58:16.146565 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-87663a62-12e7-43ce-87e3-4a668dcfffe8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:16.147084 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-87663a62-12e7-43ce-87e3-4a668dcfffe8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:16.154031 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-87663a62-12e7-43ce-87e3-4a668dcfffe8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:16.154487 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-87663a62-12e7-43ce-87e3-4a668dcfffe8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:16.156451 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-87663a62-12e7-43ce-87e3-4a668dcfffe8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:16.156451 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-87663a62-12e7-43ce-87e3-4a668dcfffe8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:16.294601 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-87663a62-12e7-43ce-87e3-4a668dcfffe8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:16.302445 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-87663a62-12e7-43ce-87e3-4a668dcfffe8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 200 len: 1264 microversion: 2.1 time: 0.159868 May 23 16:58:16.303015 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 519/1014] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:16 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:16.350062 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-4bf8adc7-3578-4016-9c16-a2e95affcc30 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:16.350758 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-4bf8adc7-3578-4016-9c16-a2e95affcc30 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] [instance: dfc0a4e9-9d6d-4889-bdf8-06127802a545] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:16.357681 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4bf8adc7-3578-4016-9c16-a2e95affcc30 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:16.358126 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4bf8adc7-3578-4016-9c16-a2e95affcc30 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:16.359045 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4bf8adc7-3578-4016-9c16-a2e95affcc30 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:16.359485 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4bf8adc7-3578-4016-9c16-a2e95affcc30 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:16.393659 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4bf8adc7-3578-4016-9c16-a2e95affcc30 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:16.394114 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-4bf8adc7-3578-4016-9c16-a2e95affcc30 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:16.394567 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.objects.instance [None req-4bf8adc7-3578-4016-9c16-a2e95affcc30 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lazy-loading 'fault' on Instance uuid dfc0a4e9-9d6d-4889-bdf8-06127802a545 {{(pid=124714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:58:16.439920 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-4bf8adc7-3578-4016-9c16-a2e95affcc30 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1462f97e2c45559a1592efcc0457ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76512cf5f51b4bc9a4a4f2bb75cc413b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:16.448890 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-4bf8adc7-3578-4016-9c16-a2e95affcc30 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] 10.222.0.74 "GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545" status: 200 len: 1304 microversion: 2.1 time: 0.103018 May 23 16:58:16.449486 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 496/1015] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:16 2022] GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:17.320404 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-fb840ae6-2847-418b-81d4-cc799cc4c725 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:17.320949 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-fb840ae6-2847-418b-81d4-cc799cc4c725 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:17.328026 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fb840ae6-2847-418b-81d4-cc799cc4c725 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:17.328534 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fb840ae6-2847-418b-81d4-cc799cc4c725 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:17.329312 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fb840ae6-2847-418b-81d4-cc799cc4c725 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:17.329757 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-fb840ae6-2847-418b-81d4-cc799cc4c725 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:17.467276 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-1e6a9023-feed-4501-918f-0af2a0545ce1 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:17.468077 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-1e6a9023-feed-4501-918f-0af2a0545ce1 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] [instance: dfc0a4e9-9d6d-4889-bdf8-06127802a545] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:17.470779 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-fb840ae6-2847-418b-81d4-cc799cc4c725 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:17.475411 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1e6a9023-feed-4501-918f-0af2a0545ce1 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:17.475876 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1e6a9023-feed-4501-918f-0af2a0545ce1 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:17.476905 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1e6a9023-feed-4501-918f-0af2a0545ce1 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:17.478325 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1e6a9023-feed-4501-918f-0af2a0545ce1 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:17.479118 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-fb840ae6-2847-418b-81d4-cc799cc4c725 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 200 len: 1264 microversion: 2.1 time: 0.162648 May 23 16:58:17.480192 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 520/1016] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:17 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:17.493328 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-1e6a9023-feed-4501-918f-0af2a0545ce1 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] HTTP exception thrown: Instance dfc0a4e9-9d6d-4889-bdf8-06127802a545 could not be found. May 23 16:58:17.495015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-1e6a9023-feed-4501-918f-0af2a0545ce1 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Request method failure captured: May 23 16:58:17.495015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545 HTTP/1.1 May 23 16:58:17.495015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 16:58:17.495015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 16:58:17.495015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 16:58:17.495015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 16:58:17.495015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 16:58:17.495015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 16:58:17.495015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 16:58:17.495015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 16:58:17.495015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii70SGNsYJqKUMwgj8RI5CgqUBQZ1xW62Rlqr7kqaRgN0M0lmUNLI9gqveMclPZj2qiHoWzFhO7qPrdk1kMH888knr3-M77yxQzYzQj5jr5w5HhUP9xI-E48ZvSRKN54--XxzzSHr-HYakmdgBe4UZ8zUqgm-ozfLuS90dyl2Lw83b-8 May 23 16:58:17.495015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 16:58:17.495015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 16:58:17.495015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 16:58:17.495015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 16:58:17.495015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 16:58:17.495015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 16:58:17.495015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: 76512cf5f51b4bc9a4a4f2bb75cc413b May 23 16:58:17.495015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-VolumesNegativeTest-565706578 May 23 16:58:17.495015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 16:58:17.495015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 16:58:17.496747 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/76512cf5f51b4bc9a4a4f2bb75cc413b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/76512cf5f51b4bc9a4a4f2bb75cc413b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/76512cf5f51b4bc9a4a4f2bb75cc413b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_76512cf5f51b4bc9a4a4f2bb75cc413b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:58:17.496747 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-VolumesNegativeTest-565706578 May 23 16:58:17.496747 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: 76512cf5f51b4bc9a4a4f2bb75cc413b May 23 16:58:17.496747 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-VolumesNegativeTest-565706578 May 23 16:58:17.496747 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-VolumesNegativeTest-565706578-project May 23 16:58:17.496747 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 16:58:17.496747 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 16:58:17.496747 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 2c1462f97e2c45559a1592efcc0457ab May 23 16:58:17.496747 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-VolumesNegativeTest-565706578-project May 23 16:58:17.496747 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: > May 23 16:58:17.496747 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Instance dfc0a4e9-9d6d-4889-bdf8-06127802a545 could not be found. May 23 16:58:17.496747 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': 'dfc0a4e9-9d6d-4889-bdf8-06127802a545'} May 23 16:58:17.497751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:58:17.497751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:58:17.497751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:58:17.497751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:58:17.497751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:58:17.497751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:58:17.497751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:58:17.497751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:58:17.497751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:58:17.497751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:58:17.497751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfc0a4e9-9d6d-4889-bdf8-06127802a545 could not be found. May 23 16:58:17.497751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:58:17.497751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:58:17.497751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:58:17.497751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:58:17.497751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:58:17.497751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:58:17.497751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:58:17.497751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:58:17.497751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:58:17.499363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:58:17.499363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:58:17.499363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:58:17.499363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:58:17.499363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:58:17.499363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:58:17.499363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:58:17.499363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfc0a4e9-9d6d-4889-bdf8-06127802a545 could not be found. May 23 16:58:17.499363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:58:17.499363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:58:17.499363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:58:17.499363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:58:17.499363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:58:17.499363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:58:17.499363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:58:17.499363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:58:17.499363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfc0a4e9-9d6d-4889-bdf8-06127802a545 could not be found. May 23 16:58:17.499363 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 16:58:17.501084 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-1e6a9023-feed-4501-918f-0af2a0545ce1 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] Returning 404 to user: Instance dfc0a4e9-9d6d-4889-bdf8-06127802a545 could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:58:17.501084 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-1e6a9023-feed-4501-918f-0af2a0545ce1 tempest-VolumesNegativeTest-565706578 tempest-VolumesNegativeTest-565706578-project] 10.222.0.74 "GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545" status: 404 len: 111 microversion: 2.1 time: 0.033177 May 23 16:58:17.501084 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 497/1017] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:17 2022] GET /compute/v2.1/servers/dfc0a4e9-9d6d-4889-bdf8-06127802a545 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:58:18.497715 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-20294299-dba2-4837-9074-7d07bdee2f9e tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:18.498331 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-20294299-dba2-4837-9074-7d07bdee2f9e tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:18.504851 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-20294299-dba2-4837-9074-7d07bdee2f9e tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:18.505163 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-20294299-dba2-4837-9074-7d07bdee2f9e tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:18.505948 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-20294299-dba2-4837-9074-7d07bdee2f9e tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:18.506388 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-20294299-dba2-4837-9074-7d07bdee2f9e tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:18.650917 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-20294299-dba2-4837-9074-7d07bdee2f9e tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:18.658493 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-20294299-dba2-4837-9074-7d07bdee2f9e tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 200 len: 1264 microversion: 2.1 time: 0.165155 May 23 16:58:18.659072 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 521/1018] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:18 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:18.999597 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-d0e6ae7d-3eba-4d18-b82d-0f303f7f3eef req-0fbf1f2a-1df9-4573-b803-96e323d2523a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d1af3a9-42b0-46e8-8c63-55256f645d1a", "name": "network-vif-plugged", "status": "completed", "tag": "5875fa7e-540a-4b73-b6a6-d251f8408804"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:58:19.004227 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=16 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:19.014265 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-d0e6ae7d-3eba-4d18-b82d-0f303f7f3eef req-0fbf1f2a-1df9-4573-b803-96e323d2523a service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:19.014712 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-d0e6ae7d-3eba-4d18-b82d-0f303f7f3eef req-0fbf1f2a-1df9-4573-b803-96e323d2523a service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:19.026593 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-d0e6ae7d-3eba-4d18-b82d-0f303f7f3eef req-0fbf1f2a-1df9-4573-b803-96e323d2523a service nova] Creating event network-vif-plugged:5875fa7e-540a-4b73-b6a6-d251f8408804 for instance 8d1af3a9-42b0-46e8-8c63-55256f645d1a on hv-cinder-83925 May 23 16:58:19.031615 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-d0e6ae7d-3eba-4d18-b82d-0f303f7f3eef req-0fbf1f2a-1df9-4573-b803-96e323d2523a service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039510 May 23 16:58:19.032559 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 498/1019] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:58:19.675722 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-b51d7e21-d8bc-4256-8228-4bf03416e9c5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:19.676351 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-b51d7e21-d8bc-4256-8228-4bf03416e9c5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:19.683793 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b51d7e21-d8bc-4256-8228-4bf03416e9c5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:19.684246 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b51d7e21-d8bc-4256-8228-4bf03416e9c5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:19.685037 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b51d7e21-d8bc-4256-8228-4bf03416e9c5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:19.685474 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b51d7e21-d8bc-4256-8228-4bf03416e9c5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:19.822602 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-b51d7e21-d8bc-4256-8228-4bf03416e9c5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:19.830115 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-b51d7e21-d8bc-4256-8228-4bf03416e9c5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 200 len: 1264 microversion: 2.1 time: 0.158313 May 23 16:58:19.831155 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 522/1020] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:19 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:58:20.850243 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-62d8fecf-4a71-4df7-86c1-8842063af7f5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:20.850939 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-62d8fecf-4a71-4df7-86c1-8842063af7f5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:20.858918 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-62d8fecf-4a71-4df7-86c1-8842063af7f5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:20.859587 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-62d8fecf-4a71-4df7-86c1-8842063af7f5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:20.860430 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-62d8fecf-4a71-4df7-86c1-8842063af7f5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:20.860884 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-62d8fecf-4a71-4df7-86c1-8842063af7f5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:21.275019 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-62d8fecf-4a71-4df7-86c1-8842063af7f5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:21.284799 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-62d8fecf-4a71-4df7-86c1-8842063af7f5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 200 len: 1264 microversion: 2.1 time: 0.439328 May 23 16:58:21.285484 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 499/1021] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:20 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 1264 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:22.302437 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-aa10af09-a67f-4a26-8925-75e3d4dfa0f5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:22.303838 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-aa10af09-a67f-4a26-8925-75e3d4dfa0f5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:22.311680 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-aa10af09-a67f-4a26-8925-75e3d4dfa0f5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:22.312143 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-aa10af09-a67f-4a26-8925-75e3d4dfa0f5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:22.312998 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-aa10af09-a67f-4a26-8925-75e3d4dfa0f5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:22.313600 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-aa10af09-a67f-4a26-8925-75e3d4dfa0f5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:22.452330 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-aa10af09-a67f-4a26-8925-75e3d4dfa0f5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:22.461166 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-aa10af09-a67f-4a26-8925-75e3d4dfa0f5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 200 len: 1451 microversion: 2.1 time: 0.163070 May 23 16:58:22.461913 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 523/1022] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:22 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:22.478111 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-b29b7575-0712-4b5c-ab92-0b34f77c24a1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:22.478868 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-b29b7575-0712-4b5c-ab92-0b34f77c24a1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:22.481288 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:22.486139 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b29b7575-0712-4b5c-ab92-0b34f77c24a1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:22.486707 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b29b7575-0712-4b5c-ab92-0b34f77c24a1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:22.487489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b29b7575-0712-4b5c-ab92-0b34f77c24a1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:22.487974 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-b29b7575-0712-4b5c-ab92-0b34f77c24a1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:22.624200 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-b29b7575-0712-4b5c-ab92-0b34f77c24a1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:22.632262 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-b29b7575-0712-4b5c-ab92-0b34f77c24a1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 200 len: 1451 microversion: 2.1 time: 0.158567 May 23 16:58:22.632880 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 500/1023] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:22 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:24.685415 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-bdd5da94-6db9-4ea5-9403-003fc85b612c req-033d76b1-c149-4c0e-b315-ae3ce73c11d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d1af3a9-42b0-46e8-8c63-55256f645d1a", "tag": "5875fa7e-540a-4b73-b6a6-d251f8408804"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:58:24.695293 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-bdd5da94-6db9-4ea5-9403-003fc85b612c req-033d76b1-c149-4c0e-b315-ae3ce73c11d3 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:24.696405 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-bdd5da94-6db9-4ea5-9403-003fc85b612c req-033d76b1-c149-4c0e-b315-ae3ce73c11d3 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:24.708891 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-bdd5da94-6db9-4ea5-9403-003fc85b612c req-033d76b1-c149-4c0e-b315-ae3ce73c11d3 service nova] Creating event network-changed:5875fa7e-540a-4b73-b6a6-d251f8408804 for instance 8d1af3a9-42b0-46e8-8c63-55256f645d1a on hv-cinder-83925 May 23 16:58:24.714842 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-bdd5da94-6db9-4ea5-9403-003fc85b612c req-033d76b1-c149-4c0e-b315-ae3ce73c11d3 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033147 May 23 16:58:24.715880 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 524/1024] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:58:29.427863 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-085ba5d2-4a8c-4dec-ac92-f14f6fb19147 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1537673926", "imageRef": "96972e76-879d-4149-a713-a94529892aad", "flavorRef": "452", "networks": [{"uuid": "13c81c78-35e7-4445-af5e-e7393bacbb4b"}]}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:58:29.482619 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.network.neutron [None req-085ba5d2-4a8c-4dec-ac92-f14f6fb19147 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] validate_networks() for [('13c81c78-35e7-4445-af5e-e7393bacbb4b', None, None, None, None, None)] {{(pid=124714) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 16:58:29.871567 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-085ba5d2-4a8c-4dec-ac92-f14f6fb19147 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Flavor limits 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 16:58:29.872001 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-085ba5d2-4a8c-4dec-ac92-f14f6fb19147 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Image limits 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 16:58:29.872527 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-085ba5d2-4a8c-4dec-ac92-f14f6fb19147 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Flavor pref 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 16:58:29.872950 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-085ba5d2-4a8c-4dec-ac92-f14f6fb19147 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Image pref 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 16:58:29.873370 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-085ba5d2-4a8c-4dec-ac92-f14f6fb19147 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 16:58:29.882628 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-085ba5d2-4a8c-4dec-ac92-f14f6fb19147 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:29.883083 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-085ba5d2-4a8c-4dec-ac92-f14f6fb19147 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:29.884454 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-085ba5d2-4a8c-4dec-ac92-f14f6fb19147 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:29.884904 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-085ba5d2-4a8c-4dec-ac92-f14f6fb19147 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:29.902802 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-085ba5d2-4a8c-4dec-ac92-f14f6fb19147 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Getting quotas for project bc5eb587a333468a9ae2107de4e9831a. Resources: {'cores', 'instances', 'ram'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:58:29.906862 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-085ba5d2-4a8c-4dec-ac92-f14f6fb19147 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Getting quotas for user a2d904021dea4643b0f4420e33d4dbf9 and project bc5eb587a333468a9ae2107de4e9831a. Resources: {'cores', 'instances', 'ram'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:58:29.918520 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-085ba5d2-4a8c-4dec-ac92-f14f6fb19147 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Going to run 1 instances... {{(pid=124714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 16:58:29.920804 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-085ba5d2-4a8c-4dec-ac92-f14f6fb19147 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 7298808e-8c25-473e-b84a-1cb7bf9b87c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96972e76-879d-4149-a713-a94529892aad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 16:58:30.066087 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-085ba5d2-4a8c-4dec-ac92-f14f6fb19147 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643615 May 23 16:58:30.066659 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 501/1025] 10.222.0.74 () {60 vars in 1146 bytes} [Mon May 23 16:58:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 16:58:30.078256 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-756e5e6c-0d82-4bc8-a296-36570a48f634 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:30.079005 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-756e5e6c-0d82-4bc8-a296-36570a48f634 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 7298808e-8c25-473e-b84a-1cb7bf9b87c3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:30.081201 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:30.136170 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-756e5e6c-0d82-4bc8-a296-36570a48f634 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:30.143116 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-756e5e6c-0d82-4bc8-a296-36570a48f634 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3" status: 200 len: 1219 microversion: 2.1 time: 0.069626 May 23 16:58:30.143816 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 525/1026] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:30 2022] GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:31.161326 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ad084399-3cfd-4f74-b0d6-0e0ac54582d0 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:31.161981 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ad084399-3cfd-4f74-b0d6-0e0ac54582d0 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 7298808e-8c25-473e-b84a-1cb7bf9b87c3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:31.168169 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ad084399-3cfd-4f74-b0d6-0e0ac54582d0 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:31.168659 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ad084399-3cfd-4f74-b0d6-0e0ac54582d0 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:31.169434 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ad084399-3cfd-4f74-b0d6-0e0ac54582d0 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:31.169948 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ad084399-3cfd-4f74-b0d6-0e0ac54582d0 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:31.233823 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ad084399-3cfd-4f74-b0d6-0e0ac54582d0 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:31.241260 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ad084399-3cfd-4f74-b0d6-0e0ac54582d0 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3" status: 200 len: 1223 microversion: 2.1 time: 0.084377 May 23 16:58:31.241822 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 502/1027] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:31 2022] GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:31.809522 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-6c952504-0c25-4c84-8f76-4bda72ecea5e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-114331444", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-312995941", "security_groups": [{"name": "tempest-secgroup-smoke-2093003610"}], "networks": [{"uuid": "3c6fcc35-289d-4f4a-b156-1d305bae8cb6"}], "block_device_mapping_v2": [{"uuid": "6bf60216-85ae-462a-bc5a-82d72c5b5719", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:58:31.922624 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.network.neutron [None req-6c952504-0c25-4c84-8f76-4bda72ecea5e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] validate_networks() for [('3c6fcc35-289d-4f4a-b156-1d305bae8cb6', None, None, None, None, None)] {{(pid=124715) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 16:58:32.260374 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-dba1be48-43c0-4c0c-b374-e378c97b1ecd tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:32.261010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-dba1be48-43c0-4c0c-b374-e378c97b1ecd tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 7298808e-8c25-473e-b84a-1cb7bf9b87c3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:32.267130 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dba1be48-43c0-4c0c-b374-e378c97b1ecd tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:32.267588 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dba1be48-43c0-4c0c-b374-e378c97b1ecd tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:32.268581 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dba1be48-43c0-4c0c-b374-e378c97b1ecd tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:32.269029 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dba1be48-43c0-4c0c-b374-e378c97b1ecd tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:32.350357 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-dba1be48-43c0-4c0c-b374-e378c97b1ecd tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:32.358833 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-dba1be48-43c0-4c0c-b374-e378c97b1ecd tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3" status: 200 len: 1279 microversion: 2.1 time: 0.103703 May 23 16:58:32.359628 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 503/1028] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:32 2022] GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3 => generated 1279 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:58:32.406992 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-6c952504-0c25-4c84-8f76-4bda72ecea5e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Flavor limits 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 16:58:32.407477 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-6c952504-0c25-4c84-8f76-4bda72ecea5e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Image limits 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 16:58:32.407963 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-6c952504-0c25-4c84-8f76-4bda72ecea5e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Flavor pref 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 16:58:32.408404 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-6c952504-0c25-4c84-8f76-4bda72ecea5e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Image pref 0:0:0 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 16:58:32.408829 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.virt.hardware [None req-6c952504-0c25-4c84-8f76-4bda72ecea5e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 16:58:32.420424 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6c952504-0c25-4c84-8f76-4bda72ecea5e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:32.420969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6c952504-0c25-4c84-8f76-4bda72ecea5e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:32.421854 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6c952504-0c25-4c84-8f76-4bda72ecea5e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:32.422422 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6c952504-0c25-4c84-8f76-4bda72ecea5e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:32.442858 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-6c952504-0c25-4c84-8f76-4bda72ecea5e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Getting quotas for project 6ae6212e50a1473a91e3abcff84f6f9b. Resources: {'cores', 'instances', 'ram'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:58:32.447655 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.quota [None req-6c952504-0c25-4c84-8f76-4bda72ecea5e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Getting quotas for user 43e80a38a048456ba61ce41648475374 and project 6ae6212e50a1473a91e3abcff84f6f9b. Resources: {'cores', 'instances', 'ram'} {{(pid=124715) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:58:32.509778 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-6c952504-0c25-4c84-8f76-4bda72ecea5e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Going to run 1 instances... {{(pid=124715) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 16:58:32.511919 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-6c952504-0c25-4c84-8f76-4bda72ecea5e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6bf60216-85ae-462a-bc5a-82d72c5b5719',volume_size=None,volume_type=None)] {{(pid=124715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 16:58:33.021278 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-6c952504-0c25-4c84-8f76-4bda72ecea5e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.216021 May 23 16:58:33.022248 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 526/1029] 10.222.0.74 () {60 vars in 1146 bytes} [Mon May 23 16:58:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 16:58:33.035829 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-dc2d87be-f2d0-4c50-8a17-81f725f6773e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:33.036673 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-dc2d87be-f2d0-4c50-8a17-81f725f6773e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:33.102767 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-dc2d87be-f2d0-4c50-8a17-81f725f6773e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:33.110887 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-dc2d87be-f2d0-4c50-8a17-81f725f6773e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1087 microversion: 2.1 time: 0.079755 May 23 16:58:33.111470 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 504/1030] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:33 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1087 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:33.376396 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-98bfc690-8533-40bc-b2ba-027fc8de3d85 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:33.376929 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-98bfc690-8533-40bc-b2ba-027fc8de3d85 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 7298808e-8c25-473e-b84a-1cb7bf9b87c3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:33.383397 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-98bfc690-8533-40bc-b2ba-027fc8de3d85 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:33.384065 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-98bfc690-8533-40bc-b2ba-027fc8de3d85 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:33.384953 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-98bfc690-8533-40bc-b2ba-027fc8de3d85 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:33.385394 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-98bfc690-8533-40bc-b2ba-027fc8de3d85 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:33.582424 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-98bfc690-8533-40bc-b2ba-027fc8de3d85 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:33.590696 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-98bfc690-8533-40bc-b2ba-027fc8de3d85 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3" status: 200 len: 1319 microversion: 2.1 time: 0.218431 May 23 16:58:33.591316 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 527/1031] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:33 2022] GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:34.127816 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-e89b07fe-7716-4e45-b23a-c03b69db4848 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:34.128515 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-e89b07fe-7716-4e45-b23a-c03b69db4848 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:34.136636 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e89b07fe-7716-4e45-b23a-c03b69db4848 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:34.137090 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e89b07fe-7716-4e45-b23a-c03b69db4848 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:34.137884 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e89b07fe-7716-4e45-b23a-c03b69db4848 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:34.138358 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e89b07fe-7716-4e45-b23a-c03b69db4848 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:34.200780 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e89b07fe-7716-4e45-b23a-c03b69db4848 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:34.208565 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-e89b07fe-7716-4e45-b23a-c03b69db4848 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1137 microversion: 2.1 time: 0.084794 May 23 16:58:34.209137 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 505/1032] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:34 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1137 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:34.542606 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-eba411a7-710c-48bf-9f8c-2153160d0e5c req-fb5af9d6-fcb2-4ca8-ae13-38b2dd9b5c56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7298808e-8c25-473e-b84a-1cb7bf9b87c3", "tag": "111126fb-3db2-4bd3-9e3c-ecb1acb4a203"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:58:34.553671 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-eba411a7-710c-48bf-9f8c-2153160d0e5c req-fb5af9d6-fcb2-4ca8-ae13-38b2dd9b5c56 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:34.554124 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-eba411a7-710c-48bf-9f8c-2153160d0e5c req-fb5af9d6-fcb2-4ca8-ae13-38b2dd9b5c56 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:34.574918 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-eba411a7-710c-48bf-9f8c-2153160d0e5c req-fb5af9d6-fcb2-4ca8-ae13-38b2dd9b5c56 service nova] Creating event network-changed:111126fb-3db2-4bd3-9e3c-ecb1acb4a203 for instance 7298808e-8c25-473e-b84a-1cb7bf9b87c3 on hv-cinder-83925 May 23 16:58:34.576561 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-eba411a7-710c-48bf-9f8c-2153160d0e5c req-fb5af9d6-fcb2-4ca8-ae13-38b2dd9b5c56 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038501 May 23 16:58:34.577301 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 528/1033] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:58:34.609902 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-e42ed495-b3d9-4325-93bf-87c9ade35ea1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:34.610526 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-e42ed495-b3d9-4325-93bf-87c9ade35ea1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 7298808e-8c25-473e-b84a-1cb7bf9b87c3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:34.616978 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e42ed495-b3d9-4325-93bf-87c9ade35ea1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:34.617444 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e42ed495-b3d9-4325-93bf-87c9ade35ea1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:34.619297 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e42ed495-b3d9-4325-93bf-87c9ade35ea1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:34.619866 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e42ed495-b3d9-4325-93bf-87c9ade35ea1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:34.825590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e42ed495-b3d9-4325-93bf-87c9ade35ea1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:34.834595 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-e42ed495-b3d9-4325-93bf-87c9ade35ea1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3" status: 200 len: 1319 microversion: 2.1 time: 0.228610 May 23 16:58:34.835190 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 506/1034] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:34 2022] GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:35.226910 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-b3d2d7e8-0316-42c8-97e3-bf47b17c5225 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:35.227886 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-b3d2d7e8-0316-42c8-97e3-bf47b17c5225 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:35.234365 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b3d2d7e8-0316-42c8-97e3-bf47b17c5225 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:35.235968 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b3d2d7e8-0316-42c8-97e3-bf47b17c5225 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:35.235968 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b3d2d7e8-0316-42c8-97e3-bf47b17c5225 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:35.236184 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b3d2d7e8-0316-42c8-97e3-bf47b17c5225 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:35.317288 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-b3d2d7e8-0316-42c8-97e3-bf47b17c5225 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:35.326162 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-b3d2d7e8-0316-42c8-97e3-bf47b17c5225 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1185 microversion: 2.1 time: 0.103862 May 23 16:58:35.334528 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 529/1035] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:35 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:58:35.852002 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-0a7ef039-3222-4c9e-8892-38b9c5e402e8 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:35.852771 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-0a7ef039-3222-4c9e-8892-38b9c5e402e8 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 7298808e-8c25-473e-b84a-1cb7bf9b87c3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:35.859372 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0a7ef039-3222-4c9e-8892-38b9c5e402e8 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:35.868811 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0a7ef039-3222-4c9e-8892-38b9c5e402e8 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:35.868811 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0a7ef039-3222-4c9e-8892-38b9c5e402e8 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:35.868811 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0a7ef039-3222-4c9e-8892-38b9c5e402e8 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:36.004220 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-0a7ef039-3222-4c9e-8892-38b9c5e402e8 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:36.012933 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-0a7ef039-3222-4c9e-8892-38b9c5e402e8 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3" status: 200 len: 1319 microversion: 2.1 time: 0.164657 May 23 16:58:36.013532 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 507/1036] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:35 2022] GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:36.343419 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-3d57972a-0bea-47aa-a7bd-32a80b0e6f5d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:36.350124 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-3d57972a-0bea-47aa-a7bd-32a80b0e6f5d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:36.350748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3d57972a-0bea-47aa-a7bd-32a80b0e6f5d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:36.351204 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3d57972a-0bea-47aa-a7bd-32a80b0e6f5d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:36.351987 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3d57972a-0bea-47aa-a7bd-32a80b0e6f5d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:36.353099 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3d57972a-0bea-47aa-a7bd-32a80b0e6f5d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:36.415812 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-3d57972a-0bea-47aa-a7bd-32a80b0e6f5d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:36.423527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-3d57972a-0bea-47aa-a7bd-32a80b0e6f5d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1203 microversion: 2.1 time: 0.083930 May 23 16:58:36.424103 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 530/1037] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:36 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1203 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:37.030155 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-86e36ee3-ccb2-4b30-b425-2059a7d42fcc tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:37.030776 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-86e36ee3-ccb2-4b30-b425-2059a7d42fcc tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 7298808e-8c25-473e-b84a-1cb7bf9b87c3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:37.037410 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-86e36ee3-ccb2-4b30-b425-2059a7d42fcc tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:37.037867 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-86e36ee3-ccb2-4b30-b425-2059a7d42fcc tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:37.038639 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-86e36ee3-ccb2-4b30-b425-2059a7d42fcc tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:37.039084 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-86e36ee3-ccb2-4b30-b425-2059a7d42fcc tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:37.166850 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-86e36ee3-ccb2-4b30-b425-2059a7d42fcc tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:37.174387 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-86e36ee3-ccb2-4b30-b425-2059a7d42fcc tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3" status: 200 len: 1319 microversion: 2.1 time: 0.148144 May 23 16:58:37.174969 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 508/1038] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:37 2022] GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:37.440937 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-cfc282fa-7736-40b7-8207-424a600ef59c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:37.441457 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-cfc282fa-7736-40b7-8207-424a600ef59c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:37.448126 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cfc282fa-7736-40b7-8207-424a600ef59c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:37.448626 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cfc282fa-7736-40b7-8207-424a600ef59c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:37.449412 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cfc282fa-7736-40b7-8207-424a600ef59c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:37.449859 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-cfc282fa-7736-40b7-8207-424a600ef59c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:37.583194 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-cfc282fa-7736-40b7-8207-424a600ef59c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:37.590715 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-cfc282fa-7736-40b7-8207-424a600ef59c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1271 microversion: 2.1 time: 0.153774 May 23 16:58:37.591305 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 531/1039] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:37 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1271 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:38.191156 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-2ed40eeb-0086-47d6-a907-51430a240c21 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:38.192448 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-2ed40eeb-0086-47d6-a907-51430a240c21 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 7298808e-8c25-473e-b84a-1cb7bf9b87c3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:38.200703 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2ed40eeb-0086-47d6-a907-51430a240c21 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:38.202090 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2ed40eeb-0086-47d6-a907-51430a240c21 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:38.202090 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2ed40eeb-0086-47d6-a907-51430a240c21 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:38.202440 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-2ed40eeb-0086-47d6-a907-51430a240c21 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:38.371015 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-2ed40eeb-0086-47d6-a907-51430a240c21 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:38.378966 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-2ed40eeb-0086-47d6-a907-51430a240c21 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3" status: 200 len: 1319 microversion: 2.1 time: 0.191683 May 23 16:58:38.379931 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 509/1040] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:38 2022] GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:38.612169 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ccbea3ff-91a6-401a-af2f-6cc9d95c3165 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:38.613153 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ccbea3ff-91a6-401a-af2f-6cc9d95c3165 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:38.630049 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ccbea3ff-91a6-401a-af2f-6cc9d95c3165 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:38.630893 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ccbea3ff-91a6-401a-af2f-6cc9d95c3165 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:38.632098 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ccbea3ff-91a6-401a-af2f-6cc9d95c3165 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:38.632731 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ccbea3ff-91a6-401a-af2f-6cc9d95c3165 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:38.771016 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-8ac854db-14ad-48e8-b0a1-17b0e06567ae req-1318e366-df4c-464d-87fe-c805a19c9def service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "925b5356-8e06-47f5-830f-74661c6f997f", "tag": "c3614cfe-7148-48d7-8938-8ee190885e3e"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:58:38.780200 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-8ac854db-14ad-48e8-b0a1-17b0e06567ae req-1318e366-df4c-464d-87fe-c805a19c9def service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:38.781100 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-8ac854db-14ad-48e8-b0a1-17b0e06567ae req-1318e366-df4c-464d-87fe-c805a19c9def service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:38.798168 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-8ac854db-14ad-48e8-b0a1-17b0e06567ae req-1318e366-df4c-464d-87fe-c805a19c9def service nova] Creating event network-changed:c3614cfe-7148-48d7-8938-8ee190885e3e for instance 925b5356-8e06-47f5-830f-74661c6f997f on hv-cinder-83925 May 23 16:58:38.803285 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-8ac854db-14ad-48e8-b0a1-17b0e06567ae req-1318e366-df4c-464d-87fe-c805a19c9def service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211313 May 23 16:58:38.804089 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 532/1041] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:58:38.809690 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-ccbea3ff-91a6-401a-af2f-6cc9d95c3165 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:38.817647 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ccbea3ff-91a6-401a-af2f-6cc9d95c3165 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1259 microversion: 2.1 time: 0.213999 May 23 16:58:38.818348 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 510/1042] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:38 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1259 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:39.397159 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-131aea6a-d60f-4d91-b4aa-1192da021a81 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:39.397866 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-131aea6a-d60f-4d91-b4aa-1192da021a81 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 7298808e-8c25-473e-b84a-1cb7bf9b87c3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:39.405248 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-131aea6a-d60f-4d91-b4aa-1192da021a81 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:39.405698 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-131aea6a-d60f-4d91-b4aa-1192da021a81 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:39.406460 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-131aea6a-d60f-4d91-b4aa-1192da021a81 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:39.406906 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-131aea6a-d60f-4d91-b4aa-1192da021a81 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:39.534818 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-131aea6a-d60f-4d91-b4aa-1192da021a81 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:39.542156 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-131aea6a-d60f-4d91-b4aa-1192da021a81 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3" status: 200 len: 1319 microversion: 2.1 time: 0.149271 May 23 16:58:39.542722 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 533/1043] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:39 2022] GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:39.836044 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-fd1d5291-9ce7-4c55-ac1b-85e6183f99b6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:39.837426 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-fd1d5291-9ce7-4c55-ac1b-85e6183f99b6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:39.843764 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fd1d5291-9ce7-4c55-ac1b-85e6183f99b6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:39.844217 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fd1d5291-9ce7-4c55-ac1b-85e6183f99b6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:39.845013 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fd1d5291-9ce7-4c55-ac1b-85e6183f99b6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:39.845457 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fd1d5291-9ce7-4c55-ac1b-85e6183f99b6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:39.893128 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=2 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:39.978736 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-fd1d5291-9ce7-4c55-ac1b-85e6183f99b6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:39.986664 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-fd1d5291-9ce7-4c55-ac1b-85e6183f99b6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1259 microversion: 2.1 time: 0.154416 May 23 16:58:39.987441 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 511/1044] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:39 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:40.560016 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-30e484e3-2b55-4473-9375-68d1102c8688 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:40.560670 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-30e484e3-2b55-4473-9375-68d1102c8688 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 7298808e-8c25-473e-b84a-1cb7bf9b87c3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:40.567128 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30e484e3-2b55-4473-9375-68d1102c8688 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:40.567588 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30e484e3-2b55-4473-9375-68d1102c8688 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:40.568394 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30e484e3-2b55-4473-9375-68d1102c8688 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:40.568841 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30e484e3-2b55-4473-9375-68d1102c8688 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:40.586556 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:40.709886 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-30e484e3-2b55-4473-9375-68d1102c8688 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:40.718324 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-30e484e3-2b55-4473-9375-68d1102c8688 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3" status: 200 len: 1319 microversion: 2.1 time: 0.163137 May 23 16:58:40.718894 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 534/1045] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:40 2022] GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:41.004344 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-70d5ee96-0468-4625-93be-07d09614bca5 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:41.004975 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-70d5ee96-0468-4625-93be-07d09614bca5 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:41.012857 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-70d5ee96-0468-4625-93be-07d09614bca5 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:41.013314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-70d5ee96-0468-4625-93be-07d09614bca5 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:41.014094 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-70d5ee96-0468-4625-93be-07d09614bca5 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:41.014536 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-70d5ee96-0468-4625-93be-07d09614bca5 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:41.073218 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-473d3379-8481-4af6-b5e5-7d388923ba60 req-d47b8868-3699-4269-8c89-1fd1aebf0d00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7298808e-8c25-473e-b84a-1cb7bf9b87c3", "name": "network-vif-plugged", "status": "completed", "tag": "111126fb-3db2-4bd3-9e3c-ecb1acb4a203"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:58:41.083387 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-473d3379-8481-4af6-b5e5-7d388923ba60 req-d47b8868-3699-4269-8c89-1fd1aebf0d00 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:41.093909 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-473d3379-8481-4af6-b5e5-7d388923ba60 req-d47b8868-3699-4269-8c89-1fd1aebf0d00 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:41.095871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-473d3379-8481-4af6-b5e5-7d388923ba60 req-d47b8868-3699-4269-8c89-1fd1aebf0d00 service nova] Creating event network-vif-plugged:111126fb-3db2-4bd3-9e3c-ecb1acb4a203 for instance 7298808e-8c25-473e-b84a-1cb7bf9b87c3 on hv-cinder-83925 May 23 16:58:41.100929 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-473d3379-8481-4af6-b5e5-7d388923ba60 req-d47b8868-3699-4269-8c89-1fd1aebf0d00 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032663 May 23 16:58:41.101511 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 535/1046] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:58:41.151207 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-70d5ee96-0468-4625-93be-07d09614bca5 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:41.158894 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-70d5ee96-0468-4625-93be-07d09614bca5 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1259 microversion: 2.1 time: 0.158506 May 23 16:58:41.159478 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 512/1047] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:40 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:58:41.737150 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-6a626268-d2ef-4e86-ba3d-d338d3cc594a tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:41.737772 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-6a626268-d2ef-4e86-ba3d-d338d3cc594a tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 7298808e-8c25-473e-b84a-1cb7bf9b87c3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:41.744950 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a626268-d2ef-4e86-ba3d-d338d3cc594a tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:41.745403 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a626268-d2ef-4e86-ba3d-d338d3cc594a tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:41.746171 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a626268-d2ef-4e86-ba3d-d338d3cc594a tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:41.746609 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6a626268-d2ef-4e86-ba3d-d338d3cc594a tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:41.875417 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-6a626268-d2ef-4e86-ba3d-d338d3cc594a tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:41.882873 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-6a626268-d2ef-4e86-ba3d-d338d3cc594a tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3" status: 200 len: 1319 microversion: 2.1 time: 0.150100 May 23 16:58:41.883928 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 536/1048] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:41 2022] GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:58:42.175781 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-490d598a-5fa2-4a5e-a158-516da7c6eafb tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:42.176449 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-490d598a-5fa2-4a5e-a158-516da7c6eafb tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:42.183934 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-490d598a-5fa2-4a5e-a158-516da7c6eafb tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:42.184575 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-490d598a-5fa2-4a5e-a158-516da7c6eafb tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:42.185350 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-490d598a-5fa2-4a5e-a158-516da7c6eafb tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:42.185794 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-490d598a-5fa2-4a5e-a158-516da7c6eafb tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:42.314899 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-490d598a-5fa2-4a5e-a158-516da7c6eafb tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:42.318298 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=100 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:42.323976 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-490d598a-5fa2-4a5e-a158-516da7c6eafb tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1259 microversion: 2.1 time: 0.152201 May 23 16:58:42.324600 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 513/1049] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:42 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:42.901986 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-af1976f2-6a2c-44ae-92d5-57cf49f9414d tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:42.902611 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-af1976f2-6a2c-44ae-92d5-57cf49f9414d tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 7298808e-8c25-473e-b84a-1cb7bf9b87c3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:42.904588 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=2 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:42.905294 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=8 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:42.910596 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-af1976f2-6a2c-44ae-92d5-57cf49f9414d tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:42.911053 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-af1976f2-6a2c-44ae-92d5-57cf49f9414d tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:42.911829 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-af1976f2-6a2c-44ae-92d5-57cf49f9414d tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:42.912276 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-af1976f2-6a2c-44ae-92d5-57cf49f9414d tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:43.047877 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-af1976f2-6a2c-44ae-92d5-57cf49f9414d tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:43.056351 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-af1976f2-6a2c-44ae-92d5-57cf49f9414d tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3" status: 200 len: 1319 microversion: 2.1 time: 0.159173 May 23 16:58:43.056947 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 537/1050] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:42 2022] GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:43.342216 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-eb77c0fd-1ee8-45ef-be9e-489005ca7727 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:43.342846 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-eb77c0fd-1ee8-45ef-be9e-489005ca7727 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:43.344701 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=8 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:58:43.350149 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-eb77c0fd-1ee8-45ef-be9e-489005ca7727 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:43.350612 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-eb77c0fd-1ee8-45ef-be9e-489005ca7727 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:43.351390 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-eb77c0fd-1ee8-45ef-be9e-489005ca7727 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:43.351839 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-eb77c0fd-1ee8-45ef-be9e-489005ca7727 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:43.482026 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-eb77c0fd-1ee8-45ef-be9e-489005ca7727 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:43.489514 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-eb77c0fd-1ee8-45ef-be9e-489005ca7727 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1259 microversion: 2.1 time: 0.151575 May 23 16:58:43.490089 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 514/1051] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:43 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:44.073793 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-9b5c66f5-43f3-4b23-89b1-adac28c55071 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:44.074349 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-9b5c66f5-43f3-4b23-89b1-adac28c55071 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 7298808e-8c25-473e-b84a-1cb7bf9b87c3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:44.081141 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9b5c66f5-43f3-4b23-89b1-adac28c55071 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:44.081590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9b5c66f5-43f3-4b23-89b1-adac28c55071 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:44.082357 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9b5c66f5-43f3-4b23-89b1-adac28c55071 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:44.082855 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-9b5c66f5-43f3-4b23-89b1-adac28c55071 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:44.219270 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-9b5c66f5-43f3-4b23-89b1-adac28c55071 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:44.226342 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-9b5c66f5-43f3-4b23-89b1-adac28c55071 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3" status: 200 len: 1509 microversion: 2.1 time: 0.157155 May 23 16:58:44.226908 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 538/1052] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:44 2022] GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:44.506199 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-8dbeff87-ebea-4076-bcb7-6bf62a7bfe5b tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:44.506821 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-8dbeff87-ebea-4076-bcb7-6bf62a7bfe5b tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:44.513919 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8dbeff87-ebea-4076-bcb7-6bf62a7bfe5b tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:44.514369 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8dbeff87-ebea-4076-bcb7-6bf62a7bfe5b tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:44.516415 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8dbeff87-ebea-4076-bcb7-6bf62a7bfe5b tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:44.516415 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8dbeff87-ebea-4076-bcb7-6bf62a7bfe5b tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:44.649738 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-8dbeff87-ebea-4076-bcb7-6bf62a7bfe5b tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:44.657496 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-8dbeff87-ebea-4076-bcb7-6bf62a7bfe5b tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1259 microversion: 2.1 time: 0.155092 May 23 16:58:44.658078 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 515/1053] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:44 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:45.674767 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-6e42a082-8338-49fb-a4be-0df9391c817d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:45.675400 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-6e42a082-8338-49fb-a4be-0df9391c817d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:45.685981 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6e42a082-8338-49fb-a4be-0df9391c817d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:45.686799 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6e42a082-8338-49fb-a4be-0df9391c817d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:45.688217 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6e42a082-8338-49fb-a4be-0df9391c817d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:45.689090 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6e42a082-8338-49fb-a4be-0df9391c817d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:45.834447 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-6e42a082-8338-49fb-a4be-0df9391c817d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:45.843003 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-6e42a082-8338-49fb-a4be-0df9391c817d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1259 microversion: 2.1 time: 0.172325 May 23 16:58:45.843575 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 539/1054] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:45 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:46.914264 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-3651dbdf-7df7-47c8-b224-86e47490daed tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:46.914895 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-3651dbdf-7df7-47c8-b224-86e47490daed tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:46.921963 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3651dbdf-7df7-47c8-b224-86e47490daed tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:46.922426 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3651dbdf-7df7-47c8-b224-86e47490daed tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:46.923206 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3651dbdf-7df7-47c8-b224-86e47490daed tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:46.923650 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3651dbdf-7df7-47c8-b224-86e47490daed tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:47.059871 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-3651dbdf-7df7-47c8-b224-86e47490daed tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:47.067576 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-3651dbdf-7df7-47c8-b224-86e47490daed tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1259 microversion: 2.1 time: 0.157353 May 23 16:58:47.068145 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 516/1055] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:46 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:48.085196 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-1c5f2372-393e-47f8-baa8-0295db6a395f tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:48.086034 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-1c5f2372-393e-47f8-baa8-0295db6a395f tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:48.093254 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1c5f2372-393e-47f8-baa8-0295db6a395f tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:48.093724 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1c5f2372-393e-47f8-baa8-0295db6a395f tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:48.094481 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1c5f2372-393e-47f8-baa8-0295db6a395f tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:48.094930 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1c5f2372-393e-47f8-baa8-0295db6a395f tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:48.228651 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-1c5f2372-393e-47f8-baa8-0295db6a395f tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:48.236864 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-1c5f2372-393e-47f8-baa8-0295db6a395f tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1259 microversion: 2.1 time: 0.155580 May 23 16:58:48.237431 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 540/1056] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:48 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:49.086175 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-f90308af-10ee-42ae-aa55-74dfe061d883 req-e8f03be6-6fb1-4d3e-809a-8eb46b3f2a38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "925b5356-8e06-47f5-830f-74661c6f997f", "name": "network-vif-plugged", "status": "completed", "tag": "c3614cfe-7148-48d7-8938-8ee190885e3e"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:58:49.094814 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-f90308af-10ee-42ae-aa55-74dfe061d883 req-e8f03be6-6fb1-4d3e-809a-8eb46b3f2a38 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:49.095409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-f90308af-10ee-42ae-aa55-74dfe061d883 req-e8f03be6-6fb1-4d3e-809a-8eb46b3f2a38 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:49.106919 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-f90308af-10ee-42ae-aa55-74dfe061d883 req-e8f03be6-6fb1-4d3e-809a-8eb46b3f2a38 service nova] Creating event network-vif-plugged:c3614cfe-7148-48d7-8938-8ee190885e3e for instance 925b5356-8e06-47f5-830f-74661c6f997f on hv-cinder-83925 May 23 16:58:49.112864 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-f90308af-10ee-42ae-aa55-74dfe061d883 req-e8f03be6-6fb1-4d3e-809a-8eb46b3f2a38 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029727 May 23 16:58:49.112864 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 517/1057] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:58:49.254073 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-f82b8b24-f084-48f8-a2a7-3196eb933dd1 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:49.254695 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-f82b8b24-f084-48f8-a2a7-3196eb933dd1 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:49.261630 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f82b8b24-f084-48f8-a2a7-3196eb933dd1 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:49.262086 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f82b8b24-f084-48f8-a2a7-3196eb933dd1 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:49.266849 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f82b8b24-f084-48f8-a2a7-3196eb933dd1 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:49.266849 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f82b8b24-f084-48f8-a2a7-3196eb933dd1 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:49.396704 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f82b8b24-f084-48f8-a2a7-3196eb933dd1 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:49.404849 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-f82b8b24-f084-48f8-a2a7-3196eb933dd1 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1259 microversion: 2.1 time: 0.154693 May 23 16:58:49.405428 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 541/1058] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:49 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:50.422600 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-89e0842c-66bc-429f-8284-6c0ab58dcc04 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:50.423262 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-89e0842c-66bc-429f-8284-6c0ab58dcc04 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:50.430025 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-89e0842c-66bc-429f-8284-6c0ab58dcc04 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:50.430481 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-89e0842c-66bc-429f-8284-6c0ab58dcc04 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:50.431253 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-89e0842c-66bc-429f-8284-6c0ab58dcc04 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:50.431698 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-89e0842c-66bc-429f-8284-6c0ab58dcc04 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:50.569396 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-89e0842c-66bc-429f-8284-6c0ab58dcc04 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:50.577416 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-89e0842c-66bc-429f-8284-6c0ab58dcc04 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1259 microversion: 2.1 time: 0.159196 May 23 16:58:50.577992 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 518/1059] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:50 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:51.596267 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-acf230f5-103f-4022-8339-d1b96e1df396 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:51.597046 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-acf230f5-103f-4022-8339-d1b96e1df396 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:51.604988 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-acf230f5-103f-4022-8339-d1b96e1df396 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:51.605440 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-acf230f5-103f-4022-8339-d1b96e1df396 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:51.606229 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-acf230f5-103f-4022-8339-d1b96e1df396 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:51.606666 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-acf230f5-103f-4022-8339-d1b96e1df396 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:51.735644 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-acf230f5-103f-4022-8339-d1b96e1df396 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:51.743210 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-acf230f5-103f-4022-8339-d1b96e1df396 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1444 microversion: 2.1 time: 0.151752 May 23 16:58:51.743821 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 542/1060] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:51 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1444 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:51.759263 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-7ac42b01-28cb-44e8-ae4f-b7ed9b2db13e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:58:51.759880 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-7ac42b01-28cb-44e8-ae4f-b7ed9b2db13e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:58:51.766840 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7ac42b01-28cb-44e8-ae4f-b7ed9b2db13e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:51.767288 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7ac42b01-28cb-44e8-ae4f-b7ed9b2db13e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:51.768051 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7ac42b01-28cb-44e8-ae4f-b7ed9b2db13e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:51.768521 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7ac42b01-28cb-44e8-ae4f-b7ed9b2db13e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:51.903260 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7ac42b01-28cb-44e8-ae4f-b7ed9b2db13e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:58:51.910871 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-7ac42b01-28cb-44e8-ae4f-b7ed9b2db13e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1444 microversion: 2.1 time: 0.155429 May 23 16:58:51.911440 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 519/1061] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:58:51 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1444 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:58:54.223578 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-03f9acdb-ac26-4bab-bd26-2180e9f1dcc6 req-ff55e3b9-fd52-4f4f-a357-6e25cab47d16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "925b5356-8e06-47f5-830f-74661c6f997f", "tag": "c3614cfe-7148-48d7-8938-8ee190885e3e"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:58:54.232693 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-03f9acdb-ac26-4bab-bd26-2180e9f1dcc6 req-ff55e3b9-fd52-4f4f-a357-6e25cab47d16 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:58:54.233142 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-03f9acdb-ac26-4bab-bd26-2180e9f1dcc6 req-ff55e3b9-fd52-4f4f-a357-6e25cab47d16 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:58:54.243955 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-03f9acdb-ac26-4bab-bd26-2180e9f1dcc6 req-ff55e3b9-fd52-4f4f-a357-6e25cab47d16 service nova] Creating event network-changed:c3614cfe-7148-48d7-8938-8ee190885e3e for instance 925b5356-8e06-47f5-830f-74661c6f997f on hv-cinder-83925 May 23 16:58:54.249996 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-03f9acdb-ac26-4bab-bd26-2180e9f1dcc6 req-ff55e3b9-fd52-4f4f-a357-6e25cab47d16 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029979 May 23 16:58:54.250538 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 543/1062] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:59:05.972721 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-e4a257ac-c40a-4296-894d-b8f6f1e5bfef tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32ebc43b-a2cc-42fc-b7ce-793a0bead9a9", "device": "/dev/sdb"}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:59:05.974341 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-e4a257ac-c40a-4296-894d-b8f6f1e5bfef tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 7298808e-8c25-473e-b84a-1cb7bf9b87c3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:59:05.976516 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:05.977171 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=32 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:05.981871 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e4a257ac-c40a-4296-894d-b8f6f1e5bfef tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:05.982320 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e4a257ac-c40a-4296-894d-b8f6f1e5bfef tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:05.983080 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e4a257ac-c40a-4296-894d-b8f6f1e5bfef tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:05.983544 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e4a257ac-c40a-4296-894d-b8f6f1e5bfef tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:06.781588 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-e4a257ac-c40a-4296-894d-b8f6f1e5bfef tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "POST /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.813033 May 23 16:59:06.782284 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 520/1063] 10.222.0.74 () {60 vars in 1322 bytes} [Mon May 23 16:59:05 2022] POST /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3/os-volume_attachments => generated 194 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:59:34.376288 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:34.377234 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=48 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:34.381765 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-597f8f3e-6e6d-49ba-8cd2-46f643230bd0 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:59:34.384227 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-597f8f3e-6e6d-49ba-8cd2-46f643230bd0 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 7298808e-8c25-473e-b84a-1cb7bf9b87c3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:59:34.388536 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-597f8f3e-6e6d-49ba-8cd2-46f643230bd0 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:34.389030 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-597f8f3e-6e6d-49ba-8cd2-46f643230bd0 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:34.389800 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-597f8f3e-6e6d-49ba-8cd2-46f643230bd0 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:34.390237 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-597f8f3e-6e6d-49ba-8cd2-46f643230bd0 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:34.471619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.objects.instance [None req-597f8f3e-6e6d-49ba-8cd2-46f643230bd0 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lazy-loading 'services' on Instance uuid 7298808e-8c25-473e-b84a-1cb7bf9b87c3 {{(pid=124715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 16:59:34.765183 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-597f8f3e-6e6d-49ba-8cd2-46f643230bd0 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "DELETE /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3/os-volume_attachments/32ebc43b-a2cc-42fc-b7ce-793a0bead9a9" status: 202 len: 0 microversion: 2.1 time: 0.390415 May 23 16:59:34.765826 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 544/1064] 10.222.0.74 () {58 vars in 1415 bytes} [Mon May 23 16:59:34 2022] DELETE /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3/os-volume_attachments/32ebc43b-a2cc-42fc-b7ce-793a0bead9a9 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 16:59:35.881961 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=2 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:35.882714 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:35.887010 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-6b7ae74f-9a31-4c49-ab52-7c4fbf702b68 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:59:35.887614 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-6b7ae74f-9a31-4c49-ab52-7c4fbf702b68 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 7298808e-8c25-473e-b84a-1cb7bf9b87c3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:59:35.894051 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6b7ae74f-9a31-4c49-ab52-7c4fbf702b68 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:35.900465 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6b7ae74f-9a31-4c49-ab52-7c4fbf702b68 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:35.900465 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6b7ae74f-9a31-4c49-ab52-7c4fbf702b68 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:35.900465 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6b7ae74f-9a31-4c49-ab52-7c4fbf702b68 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:35.921921 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-6b7ae74f-9a31-4c49-ab52-7c4fbf702b68 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 7298808e-8c25-473e-b84a-1cb7bf9b87c3] Going to try to terminate instance {{(pid=124714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 16:59:36.182627 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-6b7ae74f-9a31-4c49-ab52-7c4fbf702b68 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "DELETE /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3" status: 204 len: 0 microversion: 2.1 time: 0.301855 May 23 16:59:36.183142 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 521/1065] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 16:59:35 2022] DELETE /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 16:59:36.193096 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-77f24d58-0679-494d-b568-47c693cb2173 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:59:36.193820 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-77f24d58-0679-494d-b568-47c693cb2173 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 7298808e-8c25-473e-b84a-1cb7bf9b87c3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:59:36.200162 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-77f24d58-0679-494d-b568-47c693cb2173 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:36.200638 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-77f24d58-0679-494d-b568-47c693cb2173 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:36.201425 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-77f24d58-0679-494d-b568-47c693cb2173 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:36.201883 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-77f24d58-0679-494d-b568-47c693cb2173 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:36.340089 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-77f24d58-0679-494d-b568-47c693cb2173 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:59:36.348510 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-77f24d58-0679-494d-b568-47c693cb2173 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3" status: 200 len: 1515 microversion: 2.1 time: 0.160348 May 23 16:59:36.349076 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 545/1066] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:59:36 2022] GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:59:37.366359 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-1d7673bd-2cc7-46ce-956e-7aaa4dccf7f4 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:59:37.367111 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-1d7673bd-2cc7-46ce-956e-7aaa4dccf7f4 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 7298808e-8c25-473e-b84a-1cb7bf9b87c3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:59:37.373593 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1d7673bd-2cc7-46ce-956e-7aaa4dccf7f4 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:37.375287 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1d7673bd-2cc7-46ce-956e-7aaa4dccf7f4 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:37.376072 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1d7673bd-2cc7-46ce-956e-7aaa4dccf7f4 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:37.376548 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1d7673bd-2cc7-46ce-956e-7aaa4dccf7f4 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:37.509939 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-1d7673bd-2cc7-46ce-956e-7aaa4dccf7f4 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:59:37.517474 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-1d7673bd-2cc7-46ce-956e-7aaa4dccf7f4 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3" status: 200 len: 1515 microversion: 2.1 time: 0.155525 May 23 16:59:37.518040 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 522/1067] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:59:37 2022] GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:59:38.520328 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-2801a0e7-4a1f-4a22-9fe7-7ad6a5c6f096 req-c1f7646e-fbbb-4e96-a667-a8172259c008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7298808e-8c25-473e-b84a-1cb7bf9b87c3", "name": "network-vif-deleted", "tag": "111126fb-3db2-4bd3-9e3c-ecb1acb4a203"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:59:38.528795 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-2801a0e7-4a1f-4a22-9fe7-7ad6a5c6f096 req-c1f7646e-fbbb-4e96-a667-a8172259c008 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:38.531967 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-2801a0e7-4a1f-4a22-9fe7-7ad6a5c6f096 req-c1f7646e-fbbb-4e96-a667-a8172259c008 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:38.535389 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-cf73e28c-6c00-4470-96d9-9b52cdb5226f tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:59:38.536005 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-cf73e28c-6c00-4470-96d9-9b52cdb5226f tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 7298808e-8c25-473e-b84a-1cb7bf9b87c3] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:59:38.543013 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-2801a0e7-4a1f-4a22-9fe7-7ad6a5c6f096 req-c1f7646e-fbbb-4e96-a667-a8172259c008 service nova] Creating event network-vif-deleted:111126fb-3db2-4bd3-9e3c-ecb1acb4a203 for instance 7298808e-8c25-473e-b84a-1cb7bf9b87c3 on hv-cinder-83925 May 23 16:59:38.543260 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cf73e28c-6c00-4470-96d9-9b52cdb5226f tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:38.543933 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cf73e28c-6c00-4470-96d9-9b52cdb5226f tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:38.544729 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cf73e28c-6c00-4470-96d9-9b52cdb5226f tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:38.545166 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-cf73e28c-6c00-4470-96d9-9b52cdb5226f tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:38.548809 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-2801a0e7-4a1f-4a22-9fe7-7ad6a5c6f096 req-c1f7646e-fbbb-4e96-a667-a8172259c008 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032172 May 23 16:59:38.554886 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 546/1068] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:59:38.611958 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-cf73e28c-6c00-4470-96d9-9b52cdb5226f tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:59:38.621966 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-cf73e28c-6c00-4470-96d9-9b52cdb5226f tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3" status: 200 len: 1473 microversion: 2.1 time: 0.090886 May 23 16:59:38.622546 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 523/1069] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:59:38 2022] GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3 => generated 1473 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 16:59:39.640095 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-3c4c195a-6bda-4570-938b-26596b7f6601 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:59:39.640912 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-3c4c195a-6bda-4570-938b-26596b7f6601 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 7298808e-8c25-473e-b84a-1cb7bf9b87c3] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:59:39.647071 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3c4c195a-6bda-4570-938b-26596b7f6601 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:39.647518 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3c4c195a-6bda-4570-938b-26596b7f6601 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:39.648273 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3c4c195a-6bda-4570-938b-26596b7f6601 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:39.648736 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3c4c195a-6bda-4570-938b-26596b7f6601 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:39.662137 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-3c4c195a-6bda-4570-938b-26596b7f6601 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] HTTP exception thrown: Instance 7298808e-8c25-473e-b84a-1cb7bf9b87c3 could not be found. May 23 16:59:39.663759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-3c4c195a-6bda-4570-938b-26596b7f6601 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Request method failure captured: May 23 16:59:39.663759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3 HTTP/1.1 May 23 16:59:39.663759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 16:59:39.663759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 16:59:39.663759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 16:59:39.663759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 16:59:39.663759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 16:59:39.663759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 16:59:39.663759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 16:59:39.663759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 16:59:39.663759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii70yv577hSy2fbY9Jx2fT-tvW5Jvr_WQtNn_7-Q8UCrKKmzKfjFPtRmZdmw_xBPrkARB-VzqOBZe7_HmnS28KU0QGxLBdjrc7mRmFIqEzxB_HhZRfUoFuQbwXP0zE3eAqjMqxD6FIQZg3wt2NqIRzGj73JUsHIgcgHFD83qMXrTe5ns May 23 16:59:39.663759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 16:59:39.663759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 16:59:39.663759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 16:59:39.663759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 16:59:39.663759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 16:59:39.663759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 16:59:39.663759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: bc5eb587a333468a9ae2107de4e9831a May 23 16:59:39.663759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1851921014 May 23 16:59:39.663759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 16:59:39.663759 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 16:59:39.665523 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/bc5eb587a333468a9ae2107de4e9831a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/bc5eb587a333468a9ae2107de4e9831a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/bc5eb587a333468a9ae2107de4e9831a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_bc5eb587a333468a9ae2107de4e9831a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 16:59:39.665523 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-VolumesSnapshotTestJSON-1851921014 May 23 16:59:39.665523 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: bc5eb587a333468a9ae2107de4e9831a May 23 16:59:39.665523 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1851921014 May 23 16:59:39.665523 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-VolumesSnapshotTestJSON-1851921014-project May 23 16:59:39.665523 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 16:59:39.665523 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 16:59:39.665523 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: a2d904021dea4643b0f4420e33d4dbf9 May 23 16:59:39.665523 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-VolumesSnapshotTestJSON-1851921014-project May 23 16:59:39.665523 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 16:59:39.665523 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Instance 7298808e-8c25-473e-b84a-1cb7bf9b87c3 could not be found. May 23 16:59:39.665523 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': '7298808e-8c25-473e-b84a-1cb7bf9b87c3'} May 23 16:59:39.669622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 16:59:39.669622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:59:39.669622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 16:59:39.669622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 16:59:39.669622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 16:59:39.669622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 16:59:39.669622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 16:59:39.669622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 16:59:39.669622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 16:59:39.669622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 16:59:39.669622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7298808e-8c25-473e-b84a-1cb7bf9b87c3 could not be found. May 23 16:59:39.669622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:59:39.669622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:59:39.669622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:59:39.669622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:59:39.669622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:59:39.669622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:59:39.669622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 16:59:39.669622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 16:59:39.669622 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 16:59:39.671908 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 16:59:39.671908 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 16:59:39.671908 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 16:59:39.671908 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 16:59:39.671908 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 16:59:39.671908 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 16:59:39.671908 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 16:59:39.671908 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7298808e-8c25-473e-b84a-1cb7bf9b87c3 could not be found. May 23 16:59:39.671908 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:59:39.671908 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 16:59:39.671908 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:59:39.671908 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 16:59:39.671908 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 16:59:39.671908 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 16:59:39.671908 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 16:59:39.671908 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 16:59:39.671908 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7298808e-8c25-473e-b84a-1cb7bf9b87c3 could not be found. May 23 16:59:39.671908 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 16:59:39.673487 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-3c4c195a-6bda-4570-938b-26596b7f6601 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Returning 404 to user: Instance 7298808e-8c25-473e-b84a-1cb7bf9b87c3 could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 16:59:39.673487 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-3c4c195a-6bda-4570-938b-26596b7f6601 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3" status: 404 len: 111 microversion: 2.1 time: 0.029934 May 23 16:59:39.673487 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 547/1070] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:59:39 2022] GET /compute/v2.1/servers/7298808e-8c25-473e-b84a-1cb7bf9b87c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 16:59:51.087156 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-0cefc234-927d-481f-a9ba-777884ca57d7 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-412054942", "imageRef": "96972e76-879d-4149-a713-a94529892aad", "flavorRef": "452", "networks": [{"uuid": "13c81c78-35e7-4445-af5e-e7393bacbb4b"}]}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:59:51.094424 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:51.095084 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:51.143006 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.network.neutron [None req-0cefc234-927d-481f-a9ba-777884ca57d7 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] validate_networks() for [('13c81c78-35e7-4445-af5e-e7393bacbb4b', None, None, None, None, None)] {{(pid=124714) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 16:59:51.478229 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-0cefc234-927d-481f-a9ba-777884ca57d7 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Flavor limits 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 16:59:51.478664 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-0cefc234-927d-481f-a9ba-777884ca57d7 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Image limits 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 16:59:51.479145 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-0cefc234-927d-481f-a9ba-777884ca57d7 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Flavor pref 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 16:59:51.479561 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-0cefc234-927d-481f-a9ba-777884ca57d7 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Image pref 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 16:59:51.479978 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-0cefc234-927d-481f-a9ba-777884ca57d7 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 16:59:51.489630 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0cefc234-927d-481f-a9ba-777884ca57d7 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:51.490083 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0cefc234-927d-481f-a9ba-777884ca57d7 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:51.490887 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0cefc234-927d-481f-a9ba-777884ca57d7 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:51.491329 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-0cefc234-927d-481f-a9ba-777884ca57d7 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:51.508719 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-0cefc234-927d-481f-a9ba-777884ca57d7 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Getting quotas for project bc5eb587a333468a9ae2107de4e9831a. Resources: {'cores', 'instances', 'ram'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 16:59:51.512615 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-0cefc234-927d-481f-a9ba-777884ca57d7 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Getting quotas for user a2d904021dea4643b0f4420e33d4dbf9 and project bc5eb587a333468a9ae2107de4e9831a. Resources: {'cores', 'instances', 'ram'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 16:59:51.523655 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-0cefc234-927d-481f-a9ba-777884ca57d7 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Going to run 1 instances... {{(pid=124714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 16:59:51.525946 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-0cefc234-927d-481f-a9ba-777884ca57d7 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 98ad84a1-372f-421f-b1b4-4a5ddf8aa539] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96972e76-879d-4149-a713-a94529892aad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 16:59:51.658808 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-0cefc234-927d-481f-a9ba-777884ca57d7 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575327 May 23 16:59:51.659401 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 524/1071] 10.222.0.74 () {60 vars in 1146 bytes} [Mon May 23 16:59:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 16:59:51.669318 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e486fb4d-355c-4d86-9950-ee6a95810034 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:59:51.669944 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e486fb4d-355c-4d86-9950-ee6a95810034 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 98ad84a1-372f-421f-b1b4-4a5ddf8aa539] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:59:51.673661 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=8 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:51.674410 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:59:51.727664 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e486fb4d-355c-4d86-9950-ee6a95810034 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:59:51.735727 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e486fb4d-355c-4d86-9950-ee6a95810034 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539" status: 200 len: 1218 microversion: 2.1 time: 0.070304 May 23 16:59:51.736523 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 548/1072] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:59:51 2022] GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:59:52.753713 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-42e331ae-0686-48e8-8775-6e9399019421 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:59:52.754266 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-42e331ae-0686-48e8-8775-6e9399019421 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 98ad84a1-372f-421f-b1b4-4a5ddf8aa539] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:59:52.761249 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-42e331ae-0686-48e8-8775-6e9399019421 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:52.761711 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-42e331ae-0686-48e8-8775-6e9399019421 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:52.762599 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-42e331ae-0686-48e8-8775-6e9399019421 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:52.763040 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-42e331ae-0686-48e8-8775-6e9399019421 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:52.824101 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-42e331ae-0686-48e8-8775-6e9399019421 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:59:52.832101 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-42e331ae-0686-48e8-8775-6e9399019421 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539" status: 200 len: 1214 microversion: 2.1 time: 0.083734 May 23 16:59:52.832704 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 525/1073] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:59:52 2022] GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:59:53.849651 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-28f0093b-7386-4887-9b51-9efe68f85c74 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:59:53.850264 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-28f0093b-7386-4887-9b51-9efe68f85c74 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 98ad84a1-372f-421f-b1b4-4a5ddf8aa539] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:59:53.858422 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-28f0093b-7386-4887-9b51-9efe68f85c74 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:53.858614 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-28f0093b-7386-4887-9b51-9efe68f85c74 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:53.859328 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-28f0093b-7386-4887-9b51-9efe68f85c74 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:53.859767 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-28f0093b-7386-4887-9b51-9efe68f85c74 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:53.923967 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-28f0093b-7386-4887-9b51-9efe68f85c74 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:59:53.931402 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-28f0093b-7386-4887-9b51-9efe68f85c74 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539" status: 200 len: 1276 microversion: 2.1 time: 0.085774 May 23 16:59:53.932000 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 549/1074] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:59:53 2022] GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539 => generated 1276 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:59:54.899702 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-5bab6c45-45ed-4e63-8f7f-57e141e407bb req-e342125d-1899-4330-9a38-d4d78e80f395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98ad84a1-372f-421f-b1b4-4a5ddf8aa539", "tag": "0889c7db-cc06-4b12-b3f0-d6db0083ef20"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:59:54.908557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-5bab6c45-45ed-4e63-8f7f-57e141e407bb req-e342125d-1899-4330-9a38-d4d78e80f395 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:54.911336 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-5bab6c45-45ed-4e63-8f7f-57e141e407bb req-e342125d-1899-4330-9a38-d4d78e80f395 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:54.920901 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-5bab6c45-45ed-4e63-8f7f-57e141e407bb req-e342125d-1899-4330-9a38-d4d78e80f395 service nova] Creating event network-changed:0889c7db-cc06-4b12-b3f0-d6db0083ef20 for instance 98ad84a1-372f-421f-b1b4-4a5ddf8aa539 on hv-cinder-83925 May 23 16:59:54.926061 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-5bab6c45-45ed-4e63-8f7f-57e141e407bb req-e342125d-1899-4330-9a38-d4d78e80f395 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030037 May 23 16:59:54.926884 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 526/1075] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 16:59:54.949218 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-dbc60f42-120e-4f2b-844a-3217b3679348 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:59:54.949833 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-dbc60f42-120e-4f2b-844a-3217b3679348 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 98ad84a1-372f-421f-b1b4-4a5ddf8aa539] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:59:54.957768 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dbc60f42-120e-4f2b-844a-3217b3679348 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:54.958231 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dbc60f42-120e-4f2b-844a-3217b3679348 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:54.959014 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dbc60f42-120e-4f2b-844a-3217b3679348 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:54.959451 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-dbc60f42-120e-4f2b-844a-3217b3679348 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:55.087521 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-dbc60f42-120e-4f2b-844a-3217b3679348 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:59:55.095829 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-dbc60f42-120e-4f2b-844a-3217b3679348 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539" status: 200 len: 1318 microversion: 2.1 time: 0.150415 May 23 16:59:55.096430 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 550/1076] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:59:54 2022] GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:59:56.113411 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-94bd8902-0333-4c6b-a939-55ff82cbe828 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:59:56.114173 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-94bd8902-0333-4c6b-a939-55ff82cbe828 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 98ad84a1-372f-421f-b1b4-4a5ddf8aa539] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:59:56.120956 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-94bd8902-0333-4c6b-a939-55ff82cbe828 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:56.121413 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-94bd8902-0333-4c6b-a939-55ff82cbe828 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:56.122188 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-94bd8902-0333-4c6b-a939-55ff82cbe828 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:56.122641 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-94bd8902-0333-4c6b-a939-55ff82cbe828 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:56.253662 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-94bd8902-0333-4c6b-a939-55ff82cbe828 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:59:56.261174 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-94bd8902-0333-4c6b-a939-55ff82cbe828 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539" status: 200 len: 1318 microversion: 2.1 time: 0.151982 May 23 16:59:56.261750 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 527/1077] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:59:56 2022] GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:59:57.278690 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-e38cfb1e-80fc-4aed-83f6-ad0c2e49d7d1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:59:57.279394 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-e38cfb1e-80fc-4aed-83f6-ad0c2e49d7d1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 98ad84a1-372f-421f-b1b4-4a5ddf8aa539] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:59:57.286454 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e38cfb1e-80fc-4aed-83f6-ad0c2e49d7d1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:57.286913 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e38cfb1e-80fc-4aed-83f6-ad0c2e49d7d1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:57.287693 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e38cfb1e-80fc-4aed-83f6-ad0c2e49d7d1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:57.288139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-e38cfb1e-80fc-4aed-83f6-ad0c2e49d7d1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:57.422042 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-e38cfb1e-80fc-4aed-83f6-ad0c2e49d7d1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:59:57.429487 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-e38cfb1e-80fc-4aed-83f6-ad0c2e49d7d1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539" status: 200 len: 1318 microversion: 2.1 time: 0.154853 May 23 16:59:57.430057 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 551/1078] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:59:57 2022] GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:59:58.446913 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-64abb4b2-04f7-4d0b-bd3e-5d1f1984dac1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:59:58.447537 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-64abb4b2-04f7-4d0b-bd3e-5d1f1984dac1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 98ad84a1-372f-421f-b1b4-4a5ddf8aa539] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:59:58.454426 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-64abb4b2-04f7-4d0b-bd3e-5d1f1984dac1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:58.454884 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-64abb4b2-04f7-4d0b-bd3e-5d1f1984dac1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:58.455660 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-64abb4b2-04f7-4d0b-bd3e-5d1f1984dac1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:58.456104 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-64abb4b2-04f7-4d0b-bd3e-5d1f1984dac1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:58.586991 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-64abb4b2-04f7-4d0b-bd3e-5d1f1984dac1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:59:58.595004 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-64abb4b2-04f7-4d0b-bd3e-5d1f1984dac1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539" status: 200 len: 1318 microversion: 2.1 time: 0.151970 May 23 16:59:58.595573 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 528/1079] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:59:58 2022] GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 16:59:59.476049 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-c2d129c8-e509-4d8d-96db-e05d7a2f8425 req-09c9fe94-065c-4413-8ca3-acf2a565dc5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ad84a1-372f-421f-b1b4-4a5ddf8aa539", "name": "network-vif-plugged", "status": "completed", "tag": "0889c7db-cc06-4b12-b3f0-d6db0083ef20"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 16:59:59.485129 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-c2d129c8-e509-4d8d-96db-e05d7a2f8425 req-09c9fe94-065c-4413-8ca3-acf2a565dc5f service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:59.485579 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-c2d129c8-e509-4d8d-96db-e05d7a2f8425 req-09c9fe94-065c-4413-8ca3-acf2a565dc5f service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:59.496325 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-c2d129c8-e509-4d8d-96db-e05d7a2f8425 req-09c9fe94-065c-4413-8ca3-acf2a565dc5f service nova] Creating event network-vif-plugged:0889c7db-cc06-4b12-b3f0-d6db0083ef20 for instance 98ad84a1-372f-421f-b1b4-4a5ddf8aa539 on hv-cinder-83925 May 23 16:59:59.502268 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-c2d129c8-e509-4d8d-96db-e05d7a2f8425 req-09c9fe94-065c-4413-8ca3-acf2a565dc5f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029934 May 23 16:59:59.505886 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 552/1080] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 16:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 16:59:59.611752 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-64e288e9-5931-4a52-a33d-d6e23a1f1b65 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 16:59:59.612438 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-64e288e9-5931-4a52-a33d-d6e23a1f1b65 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 98ad84a1-372f-421f-b1b4-4a5ddf8aa539] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 16:59:59.618962 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-64e288e9-5931-4a52-a33d-d6e23a1f1b65 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:59.619415 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-64e288e9-5931-4a52-a33d-d6e23a1f1b65 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:59.620192 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-64e288e9-5931-4a52-a33d-d6e23a1f1b65 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 16:59:59.620660 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-64e288e9-5931-4a52-a33d-d6e23a1f1b65 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 16:59:59.757221 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-64e288e9-5931-4a52-a33d-d6e23a1f1b65 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 16:59:59.764796 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-64e288e9-5931-4a52-a33d-d6e23a1f1b65 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539" status: 200 len: 1318 microversion: 2.1 time: 0.157353 May 23 16:59:59.765370 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 529/1081] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 16:59:59 2022] GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:00:00.783068 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-1a35c274-9662-4353-a1ff-3a2f2269b57d tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:00:00.783791 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-1a35c274-9662-4353-a1ff-3a2f2269b57d tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 98ad84a1-372f-421f-b1b4-4a5ddf8aa539] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:00:00.789998 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1a35c274-9662-4353-a1ff-3a2f2269b57d tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:00.790434 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1a35c274-9662-4353-a1ff-3a2f2269b57d tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:00.791201 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1a35c274-9662-4353-a1ff-3a2f2269b57d tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:00.791640 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1a35c274-9662-4353-a1ff-3a2f2269b57d tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:00.926806 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-1a35c274-9662-4353-a1ff-3a2f2269b57d tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:00:00.934302 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-1a35c274-9662-4353-a1ff-3a2f2269b57d tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539" status: 200 len: 1318 microversion: 2.1 time: 0.156459 May 23 17:00:00.934870 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 553/1082] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:00:00 2022] GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:00:01.951027 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-58ae3c2c-9537-4974-9ff4-04b23ec3d223 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:00:01.952666 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-58ae3c2c-9537-4974-9ff4-04b23ec3d223 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 98ad84a1-372f-421f-b1b4-4a5ddf8aa539] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:00:01.955457 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=2 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:01.956118 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=6 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:01.961183 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-58ae3c2c-9537-4974-9ff4-04b23ec3d223 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:01.963580 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-58ae3c2c-9537-4974-9ff4-04b23ec3d223 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:01.963580 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-58ae3c2c-9537-4974-9ff4-04b23ec3d223 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:01.963580 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-58ae3c2c-9537-4974-9ff4-04b23ec3d223 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:02.105731 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-58ae3c2c-9537-4974-9ff4-04b23ec3d223 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:00:02.113595 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-58ae3c2c-9537-4974-9ff4-04b23ec3d223 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539" status: 200 len: 1508 microversion: 2.1 time: 0.166515 May 23 17:00:02.114166 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 530/1083] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:00:01 2022] GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:00:02.135280 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-3cf77c8b-ddd1-4cb2-85f9-57edbff674e3 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e31014e7-3ba4-40a1-ae95-cbf46bd1f8a9", "device": "/dev/sdb"}} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:00:02.138272 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-3cf77c8b-ddd1-4cb2-85f9-57edbff674e3 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 98ad84a1-372f-421f-b1b4-4a5ddf8aa539] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:00:02.141022 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=2 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:02.146355 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3cf77c8b-ddd1-4cb2-85f9-57edbff674e3 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:02.146812 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3cf77c8b-ddd1-4cb2-85f9-57edbff674e3 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:02.147587 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3cf77c8b-ddd1-4cb2-85f9-57edbff674e3 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:02.148102 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3cf77c8b-ddd1-4cb2-85f9-57edbff674e3 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:02.858001 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-3cf77c8b-ddd1-4cb2-85f9-57edbff674e3 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "POST /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.729304 May 23 17:00:02.858652 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 554/1084] 10.222.0.74 () {60 vars in 1322 bytes} [Mon May 23 17:00:02 2022] POST /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539/os-volume_attachments => generated 194 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:00:24.835250 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-8594d80c-f8f6-4539-919f-146aba57efc1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:00:24.835767 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-8594d80c-f8f6-4539-919f-146aba57efc1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 98ad84a1-372f-421f-b1b4-4a5ddf8aa539] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:00:24.837851 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:24.838649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=34 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:24.845598 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8594d80c-f8f6-4539-919f-146aba57efc1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:24.850007 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8594d80c-f8f6-4539-919f-146aba57efc1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:24.850007 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8594d80c-f8f6-4539-919f-146aba57efc1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:24.850007 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-8594d80c-f8f6-4539-919f-146aba57efc1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:24.937219 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.objects.instance [None req-8594d80c-f8f6-4539-919f-146aba57efc1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lazy-loading 'services' on Instance uuid 98ad84a1-372f-421f-b1b4-4a5ddf8aa539 {{(pid=124714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:00:25.195127 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-8594d80c-f8f6-4539-919f-146aba57efc1 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "DELETE /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539/os-volume_attachments/e31014e7-3ba4-40a1-ae95-cbf46bd1f8a9" status: 202 len: 0 microversion: 2.1 time: 0.363619 May 23 17:00:25.195774 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 531/1085] 10.222.0.74 () {58 vars in 1415 bytes} [Mon May 23 17:00:24 2022] DELETE /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539/os-volume_attachments/e31014e7-3ba4-40a1-ae95-cbf46bd1f8a9 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:00:26.308689 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-0a7fcc96-982f-4c78-9c2a-e74919192b33 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:00:26.313333 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-0a7fcc96-982f-4c78-9c2a-e74919192b33 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 98ad84a1-372f-421f-b1b4-4a5ddf8aa539] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:00:26.313333 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=16 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:26.313333 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:26.318051 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0a7fcc96-982f-4c78-9c2a-e74919192b33 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:26.318643 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0a7fcc96-982f-4c78-9c2a-e74919192b33 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:26.319419 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0a7fcc96-982f-4c78-9c2a-e74919192b33 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:26.319866 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0a7fcc96-982f-4c78-9c2a-e74919192b33 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:26.347635 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-0a7fcc96-982f-4c78-9c2a-e74919192b33 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 98ad84a1-372f-421f-b1b4-4a5ddf8aa539] Going to try to terminate instance {{(pid=124715) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:00:26.612028 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-0a7fcc96-982f-4c78-9c2a-e74919192b33 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "DELETE /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539" status: 204 len: 0 microversion: 2.1 time: 0.307700 May 23 17:00:26.612869 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 555/1086] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 17:00:26 2022] DELETE /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 17:00:26.621840 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-d170bf88-e167-48a5-8a03-c586e5100ef3 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:00:26.622544 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-d170bf88-e167-48a5-8a03-c586e5100ef3 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 98ad84a1-372f-421f-b1b4-4a5ddf8aa539] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:00:26.629051 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d170bf88-e167-48a5-8a03-c586e5100ef3 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:26.629497 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d170bf88-e167-48a5-8a03-c586e5100ef3 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:26.633365 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d170bf88-e167-48a5-8a03-c586e5100ef3 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:26.633365 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d170bf88-e167-48a5-8a03-c586e5100ef3 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:26.762201 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-d170bf88-e167-48a5-8a03-c586e5100ef3 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:00:26.770126 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-d170bf88-e167-48a5-8a03-c586e5100ef3 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539" status: 200 len: 1514 microversion: 2.1 time: 0.153080 May 23 17:00:26.770692 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 532/1087] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:00:26 2022] GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:00:27.787865 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-56e6e62c-4de6-4810-94b5-f7f8c6ef0a36 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:00:27.788632 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-56e6e62c-4de6-4810-94b5-f7f8c6ef0a36 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 98ad84a1-372f-421f-b1b4-4a5ddf8aa539] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:00:27.795220 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-56e6e62c-4de6-4810-94b5-f7f8c6ef0a36 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:27.795678 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-56e6e62c-4de6-4810-94b5-f7f8c6ef0a36 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:27.797079 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-56e6e62c-4de6-4810-94b5-f7f8c6ef0a36 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:27.797526 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-56e6e62c-4de6-4810-94b5-f7f8c6ef0a36 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:27.926654 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-56e6e62c-4de6-4810-94b5-f7f8c6ef0a36 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:00:27.934057 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-56e6e62c-4de6-4810-94b5-f7f8c6ef0a36 tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539" status: 200 len: 1514 microversion: 2.1 time: 0.150457 May 23 17:00:27.934619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 556/1088] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:00:27 2022] GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:00:28.951175 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-6df3c8e9-6416-4961-918c-a5bc82f0dd3a tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:00:28.951787 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-6df3c8e9-6416-4961-918c-a5bc82f0dd3a tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 98ad84a1-372f-421f-b1b4-4a5ddf8aa539] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:00:28.958824 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6df3c8e9-6416-4961-918c-a5bc82f0dd3a tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:28.959277 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6df3c8e9-6416-4961-918c-a5bc82f0dd3a tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:28.960083 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6df3c8e9-6416-4961-918c-a5bc82f0dd3a tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:28.960587 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6df3c8e9-6416-4961-918c-a5bc82f0dd3a tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:28.980245 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-a964e8fd-6e0e-4c34-b208-5705cfe1481f req-8d3fcaea-59a3-4e2c-bae4-a98ecdd2d729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ad84a1-372f-421f-b1b4-4a5ddf8aa539", "name": "network-vif-deleted", "tag": "0889c7db-cc06-4b12-b3f0-d6db0083ef20"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:00:28.989579 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-a964e8fd-6e0e-4c34-b208-5705cfe1481f req-8d3fcaea-59a3-4e2c-bae4-a98ecdd2d729 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:28.990022 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-a964e8fd-6e0e-4c34-b208-5705cfe1481f req-8d3fcaea-59a3-4e2c-bae4-a98ecdd2d729 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:29.001906 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-a964e8fd-6e0e-4c34-b208-5705cfe1481f req-8d3fcaea-59a3-4e2c-bae4-a98ecdd2d729 service nova] Creating event network-vif-deleted:0889c7db-cc06-4b12-b3f0-d6db0083ef20 for instance 98ad84a1-372f-421f-b1b4-4a5ddf8aa539 on hv-cinder-83925 May 23 17:00:29.006840 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-a964e8fd-6e0e-4c34-b208-5705cfe1481f req-8d3fcaea-59a3-4e2c-bae4-a98ecdd2d729 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030161 May 23 17:00:29.007397 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 557/1089] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 17:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:00:29.030916 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-6df3c8e9-6416-4961-918c-a5bc82f0dd3a tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d904021dea4643b0f4420e33d4dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5eb587a333468a9ae2107de4e9831a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:00:29.038741 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-6df3c8e9-6416-4961-918c-a5bc82f0dd3a tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539" status: 200 len: 1472 microversion: 2.1 time: 0.091463 May 23 17:00:29.039314 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 533/1090] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:00:28 2022] GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539 => generated 1472 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:00:30.057453 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-43ec4e7f-911e-4996-a2e9-a14c02627c6e tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:00:30.058150 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-43ec4e7f-911e-4996-a2e9-a14c02627c6e tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] [instance: 98ad84a1-372f-421f-b1b4-4a5ddf8aa539] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:00:30.065306 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-43ec4e7f-911e-4996-a2e9-a14c02627c6e tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:30.065752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-43ec4e7f-911e-4996-a2e9-a14c02627c6e tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:30.066574 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-43ec4e7f-911e-4996-a2e9-a14c02627c6e tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:30.067024 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-43ec4e7f-911e-4996-a2e9-a14c02627c6e tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:30.081547 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-43ec4e7f-911e-4996-a2e9-a14c02627c6e tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] HTTP exception thrown: Instance 98ad84a1-372f-421f-b1b4-4a5ddf8aa539 could not be found. May 23 17:00:30.083153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-43ec4e7f-911e-4996-a2e9-a14c02627c6e tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Request method failure captured: May 23 17:00:30.083153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539 HTTP/1.1 May 23 17:00:30.083153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 17:00:30.083153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 17:00:30.083153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 17:00:30.083153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 17:00:30.083153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 17:00:30.083153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 17:00:30.083153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 17:00:30.083153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 17:00:30.083153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii70yv577hSy2fbY9Jx2fT-tvW5Jvr_WQtNn_7-Q8UCrKKmzKfjFPtRmZdmw_xBPrkARB-VzqOBZe7_HmnS28KU0QGxLBdjrc7mRmFIqEzxB_HhZRfUoFuQbwXP0zE3eAqjMqxD6FIQZg3wt2NqIRzGj73JUsHIgcgHFD83qMXrTe5ns May 23 17:00:30.083153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 17:00:30.083153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 17:00:30.083153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 17:00:30.083153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 17:00:30.083153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 17:00:30.083153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 17:00:30.083153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: bc5eb587a333468a9ae2107de4e9831a May 23 17:00:30.083153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1851921014 May 23 17:00:30.083153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 17:00:30.083153 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 17:00:30.084986 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/bc5eb587a333468a9ae2107de4e9831a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/bc5eb587a333468a9ae2107de4e9831a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/bc5eb587a333468a9ae2107de4e9831a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_bc5eb587a333468a9ae2107de4e9831a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 17:00:30.084986 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-VolumesSnapshotTestJSON-1851921014 May 23 17:00:30.084986 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: bc5eb587a333468a9ae2107de4e9831a May 23 17:00:30.084986 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1851921014 May 23 17:00:30.084986 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-VolumesSnapshotTestJSON-1851921014-project May 23 17:00:30.084986 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 17:00:30.084986 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 17:00:30.084986 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: a2d904021dea4643b0f4420e33d4dbf9 May 23 17:00:30.084986 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-VolumesSnapshotTestJSON-1851921014-project May 23 17:00:30.084986 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 17:00:30.084986 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Instance 98ad84a1-372f-421f-b1b4-4a5ddf8aa539 could not be found. May 23 17:00:30.084986 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': '98ad84a1-372f-421f-b1b4-4a5ddf8aa539'} May 23 17:00:30.086032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:00:30.086032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:00:30.086032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:00:30.086032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:00:30.086032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:00:30.086032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:00:30.086032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:00:30.086032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:00:30.086032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:00:30.086032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:00:30.086032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98ad84a1-372f-421f-b1b4-4a5ddf8aa539 could not be found. May 23 17:00:30.086032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 17:00:30.086032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:00:30.086032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 17:00:30.086032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:00:30.086032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:00:30.086032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:00:30.086032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:00:30.086032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:00:30.086032 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:00:30.087707 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:00:30.087707 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:00:30.087707 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:00:30.087707 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:00:30.087707 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:00:30.087707 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:00:30.087707 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:00:30.087707 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98ad84a1-372f-421f-b1b4-4a5ddf8aa539 could not be found. May 23 17:00:30.087707 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 17:00:30.087707 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:00:30.087707 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 17:00:30.087707 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:00:30.087707 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:00:30.087707 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:00:30.087707 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:00:30.087707 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:00:30.087707 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98ad84a1-372f-421f-b1b4-4a5ddf8aa539 could not be found. May 23 17:00:30.087707 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 17:00:30.089298 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-43ec4e7f-911e-4996-a2e9-a14c02627c6e tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] Returning 404 to user: Instance 98ad84a1-372f-421f-b1b4-4a5ddf8aa539 could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:00:30.089298 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-43ec4e7f-911e-4996-a2e9-a14c02627c6e tempest-VolumesSnapshotTestJSON-1851921014 tempest-VolumesSnapshotTestJSON-1851921014-project] 10.222.0.74 "GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539" status: 404 len: 111 microversion: 2.1 time: 0.032067 May 23 17:00:30.089298 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 558/1091] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:00:30 2022] GET /compute/v2.1/servers/98ad84a1-372f-421f-b1b4-4a5ddf8aa539 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:00:38.994728 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:00:38.995469 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Mon May 23 17:00:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:00:46.558814 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:00:46.559304 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Mon May 23 17:00:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:00:47.527608 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-d2931d23-8ffa-409e-91dc-eed9148c21e7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1122048544", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-877096425", "security_groups": [{"name": "tempest-secgroup-smoke-1810518830"}], "block_device_mapping_v2": [{"uuid": "6b899ee9-3f37-41a0-9fee-b6cfaf64fd4f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "919d5a7a-cf43-4ee4-a633-f9112228c533"}]}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:00:47.537359 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=6 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:47.538031 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:47.718934 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.network.neutron [None req-d2931d23-8ffa-409e-91dc-eed9148c21e7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] validate_networks() for [('919d5a7a-cf43-4ee4-a633-f9112228c533', None, None, None, None, None)] {{(pid=124714) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 17:00:48.081181 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-d2931d23-8ffa-409e-91dc-eed9148c21e7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Flavor limits 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 17:00:48.086307 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-d2931d23-8ffa-409e-91dc-eed9148c21e7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Image limits 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 17:00:48.086307 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-d2931d23-8ffa-409e-91dc-eed9148c21e7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Flavor pref 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 17:00:48.086307 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-d2931d23-8ffa-409e-91dc-eed9148c21e7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Image pref 0:0:0 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 17:00:48.086307 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.virt.hardware [None req-d2931d23-8ffa-409e-91dc-eed9148c21e7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 17:00:48.091728 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d2931d23-8ffa-409e-91dc-eed9148c21e7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:48.092271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d2931d23-8ffa-409e-91dc-eed9148c21e7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:48.093707 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d2931d23-8ffa-409e-91dc-eed9148c21e7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:48.094252 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d2931d23-8ffa-409e-91dc-eed9148c21e7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:48.115444 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-d2931d23-8ffa-409e-91dc-eed9148c21e7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Getting quotas for project 8d09d9819e564152aacc661d1da68fcd. Resources: {'cores', 'instances', 'ram'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:00:48.121013 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.quota [None req-d2931d23-8ffa-409e-91dc-eed9148c21e7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Getting quotas for user 2aa01ac54736475188dbc47f3cda4de1 and project 8d09d9819e564152aacc661d1da68fcd. Resources: {'cores', 'instances', 'ram'} {{(pid=124714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:00:48.180760 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-d2931d23-8ffa-409e-91dc-eed9148c21e7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Going to run 1 instances... {{(pid=124714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 17:00:48.182878 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-d2931d23-8ffa-409e-91dc-eed9148c21e7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6b899ee9-3f37-41a0-9fee-b6cfaf64fd4f',volume_size=None,volume_type=None)] {{(pid=124714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 17:00:48.601653 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-d2931d23-8ffa-409e-91dc-eed9148c21e7 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.078031 May 23 17:00:48.602477 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 534/1092] 10.222.0.74 () {60 vars in 1146 bytes} [Mon May 23 17:00:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 17:00:48.617662 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-6c7ffe77-b83c-4725-9fae-29c3cb0ebab5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:00:48.618363 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-6c7ffe77-b83c-4725-9fae-29c3cb0ebab5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:00:48.620721 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:48.621369 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:48.734386 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-6c7ffe77-b83c-4725-9fae-29c3cb0ebab5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:00:48.739183 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-6c7ffe77-b83c-4725-9fae-29c3cb0ebab5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1094 microversion: 2.1 time: 0.125331 May 23 17:00:48.748508 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 559/1093] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:00:48 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1094 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:00:49.757251 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-fe5811be-d012-4188-ad9e-d33d31728078 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:00:49.757778 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-fe5811be-d012-4188-ad9e-d33d31728078 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:00:49.763974 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fe5811be-d012-4188-ad9e-d33d31728078 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:49.764467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fe5811be-d012-4188-ad9e-d33d31728078 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:49.765239 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fe5811be-d012-4188-ad9e-d33d31728078 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:49.765684 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fe5811be-d012-4188-ad9e-d33d31728078 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:49.826436 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-fe5811be-d012-4188-ad9e-d33d31728078 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:00:49.834601 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-fe5811be-d012-4188-ad9e-d33d31728078 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1144 microversion: 2.1 time: 0.081788 May 23 17:00:49.835165 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 535/1094] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:00:49 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:00:50.851740 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-2fc21821-508a-4ae1-9b18-32c6abe7eced tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:00:50.852416 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-2fc21821-508a-4ae1-9b18-32c6abe7eced tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:00:50.860065 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2fc21821-508a-4ae1-9b18-32c6abe7eced tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:50.861549 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2fc21821-508a-4ae1-9b18-32c6abe7eced tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:50.862330 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2fc21821-508a-4ae1-9b18-32c6abe7eced tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:50.862780 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2fc21821-508a-4ae1-9b18-32c6abe7eced tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:50.923041 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-2fc21821-508a-4ae1-9b18-32c6abe7eced tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:00:50.930492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-2fc21821-508a-4ae1-9b18-32c6abe7eced tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1144 microversion: 2.1 time: 0.082767 May 23 17:00:50.931053 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 560/1095] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:00:50 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:00:51.947511 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-aad30aa9-e481-494c-a9c1-0d25ed9e319f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:00:51.948185 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-aad30aa9-e481-494c-a9c1-0d25ed9e319f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:00:51.955478 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-aad30aa9-e481-494c-a9c1-0d25ed9e319f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:51.956049 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-aad30aa9-e481-494c-a9c1-0d25ed9e319f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:51.956853 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-aad30aa9-e481-494c-a9c1-0d25ed9e319f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:51.957309 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-aad30aa9-e481-494c-a9c1-0d25ed9e319f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:52.023485 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-aad30aa9-e481-494c-a9c1-0d25ed9e319f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:00:52.030925 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-aad30aa9-e481-494c-a9c1-0d25ed9e319f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1136 microversion: 2.1 time: 0.087379 May 23 17:00:52.031489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 536/1096] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:00:51 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1136 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:00:53.047899 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-b3b27f52-7577-4803-8945-fc1c9ab25364 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:00:53.048535 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-b3b27f52-7577-4803-8945-fc1c9ab25364 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:00:53.055654 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b3b27f52-7577-4803-8945-fc1c9ab25364 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:53.056094 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b3b27f52-7577-4803-8945-fc1c9ab25364 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:53.056888 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b3b27f52-7577-4803-8945-fc1c9ab25364 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:53.057325 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b3b27f52-7577-4803-8945-fc1c9ab25364 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:53.120578 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-b3b27f52-7577-4803-8945-fc1c9ab25364 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:00:53.128170 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-b3b27f52-7577-4803-8945-fc1c9ab25364 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1136 microversion: 2.1 time: 0.084036 May 23 17:00:53.128694 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 561/1097] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:00:53 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1136 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:00:54.151192 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-9b8c1bf7-2924-4867-8fa9-5838840ccd24 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:00:54.151811 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-9b8c1bf7-2924-4867-8fa9-5838840ccd24 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:00:54.158353 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9b8c1bf7-2924-4867-8fa9-5838840ccd24 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:54.159239 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9b8c1bf7-2924-4867-8fa9-5838840ccd24 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:54.160184 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9b8c1bf7-2924-4867-8fa9-5838840ccd24 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:54.160646 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9b8c1bf7-2924-4867-8fa9-5838840ccd24 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:54.223580 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-9b8c1bf7-2924-4867-8fa9-5838840ccd24 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:00:54.230949 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-9b8c1bf7-2924-4867-8fa9-5838840ccd24 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1210 microversion: 2.1 time: 0.083807 May 23 17:00:54.231512 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 537/1098] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:00:54 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:00:55.249434 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-1e64fdb9-4d02-47ca-891c-11e34cf36231 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:00:55.250096 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-1e64fdb9-4d02-47ca-891c-11e34cf36231 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:00:55.256708 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1e64fdb9-4d02-47ca-891c-11e34cf36231 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:55.257242 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1e64fdb9-4d02-47ca-891c-11e34cf36231 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:55.258073 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1e64fdb9-4d02-47ca-891c-11e34cf36231 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:55.258582 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-1e64fdb9-4d02-47ca-891c-11e34cf36231 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:55.374684 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-196b2569-44bd-42c2-88a1-daef8d19f659 req-04937ab1-54a1-4659-b5d0-fa1c12ae0b45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a77bc915-5eb5-4d31-85e1-812535fdbc66", "tag": "78fc2089-0ff9-484b-bad9-e4a3a46fa4d0"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:00:55.391184 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-196b2569-44bd-42c2-88a1-daef8d19f659 req-04937ab1-54a1-4659-b5d0-fa1c12ae0b45 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:55.391184 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-196b2569-44bd-42c2-88a1-daef8d19f659 req-04937ab1-54a1-4659-b5d0-fa1c12ae0b45 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:55.403922 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-196b2569-44bd-42c2-88a1-daef8d19f659 req-04937ab1-54a1-4659-b5d0-fa1c12ae0b45 service nova] Creating event network-changed:78fc2089-0ff9-484b-bad9-e4a3a46fa4d0 for instance a77bc915-5eb5-4d31-85e1-812535fdbc66 on hv-cinder-83925 May 23 17:00:55.410037 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-1e64fdb9-4d02-47ca-891c-11e34cf36231 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:00:55.411393 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-196b2569-44bd-42c2-88a1-daef8d19f659 req-04937ab1-54a1-4659-b5d0-fa1c12ae0b45 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040436 May 23 17:00:55.412326 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 538/1099] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 17:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:00:55.427308 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-1e64fdb9-4d02-47ca-891c-11e34cf36231 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1266 microversion: 2.1 time: 0.172921 May 23 17:00:55.427308 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 562/1100] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:00:55 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:00:56.440139 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-14e4b32a-eebe-4fe9-b654-8838c19cd830 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:00:56.440810 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-14e4b32a-eebe-4fe9-b654-8838c19cd830 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:00:56.447035 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-14e4b32a-eebe-4fe9-b654-8838c19cd830 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:56.447489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-14e4b32a-eebe-4fe9-b654-8838c19cd830 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:56.448252 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-14e4b32a-eebe-4fe9-b654-8838c19cd830 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:56.448719 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-14e4b32a-eebe-4fe9-b654-8838c19cd830 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:56.590217 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-14e4b32a-eebe-4fe9-b654-8838c19cd830 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:00:56.598601 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-14e4b32a-eebe-4fe9-b654-8838c19cd830 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1266 microversion: 2.1 time: 0.163386 May 23 17:00:56.599231 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 539/1101] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:00:56 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:00:57.617103 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a4a99830-afc5-46b6-af1c-0f00fb41a3d5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:00:57.617756 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a4a99830-afc5-46b6-af1c-0f00fb41a3d5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:00:57.624308 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a4a99830-afc5-46b6-af1c-0f00fb41a3d5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:57.624772 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a4a99830-afc5-46b6-af1c-0f00fb41a3d5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:57.625578 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a4a99830-afc5-46b6-af1c-0f00fb41a3d5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:57.626307 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a4a99830-afc5-46b6-af1c-0f00fb41a3d5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:57.756332 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a4a99830-afc5-46b6-af1c-0f00fb41a3d5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:00:57.765576 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a4a99830-afc5-46b6-af1c-0f00fb41a3d5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1266 microversion: 2.1 time: 0.152302 May 23 17:00:57.766183 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 563/1102] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:00:57 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:00:58.783304 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-40c68396-b477-4b97-8442-e9573b1e225f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:00:58.783853 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-40c68396-b477-4b97-8442-e9573b1e225f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:00:58.786343 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=2 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:58.789656 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell0:SELECT=6 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:58.791869 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-40c68396-b477-4b97-8442-e9573b1e225f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:58.792426 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-40c68396-b477-4b97-8442-e9573b1e225f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:58.793206 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-40c68396-b477-4b97-8442-e9573b1e225f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:58.793651 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-40c68396-b477-4b97-8442-e9573b1e225f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:58.927179 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-40c68396-b477-4b97-8442-e9573b1e225f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:00:58.934968 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-40c68396-b477-4b97-8442-e9573b1e225f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1266 microversion: 2.1 time: 0.155868 May 23 17:00:58.935566 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 540/1103] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:00:58 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:00:59.953463 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-996376ca-e787-4295-97cf-542dea26a50b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:00:59.954091 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-996376ca-e787-4295-97cf-542dea26a50b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:00:59.956996 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell0:SELECT=2 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:00:59.961849 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-996376ca-e787-4295-97cf-542dea26a50b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:59.967429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-996376ca-e787-4295-97cf-542dea26a50b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:00:59.967429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-996376ca-e787-4295-97cf-542dea26a50b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:00:59.967429 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-996376ca-e787-4295-97cf-542dea26a50b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:00.094368 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-996376ca-e787-4295-97cf-542dea26a50b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:00.102542 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-996376ca-e787-4295-97cf-542dea26a50b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1266 microversion: 2.1 time: 0.153195 May 23 17:01:00.103100 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 564/1104] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:00:59 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:01.119838 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-e1529ffb-9b82-4dc0-bc87-92e3f0cd92c5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:01.120545 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-e1529ffb-9b82-4dc0-bc87-92e3f0cd92c5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:01.127507 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e1529ffb-9b82-4dc0-bc87-92e3f0cd92c5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:01.127956 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e1529ffb-9b82-4dc0-bc87-92e3f0cd92c5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:01.128761 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e1529ffb-9b82-4dc0-bc87-92e3f0cd92c5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:01.129204 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e1529ffb-9b82-4dc0-bc87-92e3f0cd92c5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:01.261419 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e1529ffb-9b82-4dc0-bc87-92e3f0cd92c5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:01.269180 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-e1529ffb-9b82-4dc0-bc87-92e3f0cd92c5 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1266 microversion: 2.1 time: 0.153397 May 23 17:01:01.269751 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 541/1105] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:01 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:02.285945 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-df1bba34-2b12-4538-9c74-4c71e2a6682b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:02.286590 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-df1bba34-2b12-4538-9c74-4c71e2a6682b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:02.293108 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-df1bba34-2b12-4538-9c74-4c71e2a6682b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:02.293560 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-df1bba34-2b12-4538-9c74-4c71e2a6682b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:02.294326 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-df1bba34-2b12-4538-9c74-4c71e2a6682b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:02.294819 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-df1bba34-2b12-4538-9c74-4c71e2a6682b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:02.428085 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-df1bba34-2b12-4538-9c74-4c71e2a6682b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:02.435522 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-df1bba34-2b12-4538-9c74-4c71e2a6682b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1266 microversion: 2.1 time: 0.153666 May 23 17:01:02.436088 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 565/1106] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:02 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:01:03.453487 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-7880c4d4-930b-46be-b714-efc1c74bab51 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:03.454107 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-7880c4d4-930b-46be-b714-efc1c74bab51 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:03.461749 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7880c4d4-930b-46be-b714-efc1c74bab51 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:03.462397 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7880c4d4-930b-46be-b714-efc1c74bab51 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:03.462981 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7880c4d4-930b-46be-b714-efc1c74bab51 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:03.463430 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-7880c4d4-930b-46be-b714-efc1c74bab51 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:03.602435 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-7880c4d4-930b-46be-b714-efc1c74bab51 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:03.610023 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-7880c4d4-930b-46be-b714-efc1c74bab51 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1266 microversion: 2.1 time: 0.160792 May 23 17:01:03.610603 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 542/1107] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:03 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:04.628092 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-30adff97-5af5-4d06-91a5-db4798db8ce8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:04.628663 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-30adff97-5af5-4d06-91a5-db4798db8ce8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:04.635694 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30adff97-5af5-4d06-91a5-db4798db8ce8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:04.636154 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30adff97-5af5-4d06-91a5-db4798db8ce8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:04.636969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30adff97-5af5-4d06-91a5-db4798db8ce8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:04.637424 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30adff97-5af5-4d06-91a5-db4798db8ce8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:04.771319 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-30adff97-5af5-4d06-91a5-db4798db8ce8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:04.779147 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-30adff97-5af5-4d06-91a5-db4798db8ce8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1266 microversion: 2.1 time: 0.155638 May 23 17:01:04.779716 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 566/1108] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:04 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:05.797037 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-eedc6f3d-fcbf-4ce8-be66-cddd700380f6 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:05.797655 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-eedc6f3d-fcbf-4ce8-be66-cddd700380f6 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:05.804605 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-eedc6f3d-fcbf-4ce8-be66-cddd700380f6 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:05.805057 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-eedc6f3d-fcbf-4ce8-be66-cddd700380f6 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:05.805824 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-eedc6f3d-fcbf-4ce8-be66-cddd700380f6 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:05.806263 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-eedc6f3d-fcbf-4ce8-be66-cddd700380f6 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:05.944586 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-eedc6f3d-fcbf-4ce8-be66-cddd700380f6 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:05.952949 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-eedc6f3d-fcbf-4ce8-be66-cddd700380f6 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1266 microversion: 2.1 time: 0.159682 May 23 17:01:05.963012 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 543/1109] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:05 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:06.977867 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-68eb7040-71bc-495e-9773-3ee466f1e5c8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:06.977867 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-68eb7040-71bc-495e-9773-3ee466f1e5c8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:06.979522 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-68eb7040-71bc-495e-9773-3ee466f1e5c8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:06.979968 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-68eb7040-71bc-495e-9773-3ee466f1e5c8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:06.980786 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-68eb7040-71bc-495e-9773-3ee466f1e5c8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:06.981251 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-68eb7040-71bc-495e-9773-3ee466f1e5c8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:07.114782 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-68eb7040-71bc-495e-9773-3ee466f1e5c8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:07.122320 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-68eb7040-71bc-495e-9773-3ee466f1e5c8 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1266 microversion: 2.1 time: 0.155440 May 23 17:01:07.122853 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 567/1110] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:06 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:07.934129 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-022e096f-f60a-41f6-bcd3-066bb1456c7d req-bc7b52dd-5665-4827-9dc3-313a57c6a7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a77bc915-5eb5-4d31-85e1-812535fdbc66", "name": "network-vif-plugged", "status": "completed", "tag": "78fc2089-0ff9-484b-bad9-e4a3a46fa4d0"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:01:07.943484 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-022e096f-f60a-41f6-bcd3-066bb1456c7d req-bc7b52dd-5665-4827-9dc3-313a57c6a7a0 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:07.943675 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-022e096f-f60a-41f6-bcd3-066bb1456c7d req-bc7b52dd-5665-4827-9dc3-313a57c6a7a0 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:07.954854 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-022e096f-f60a-41f6-bcd3-066bb1456c7d req-bc7b52dd-5665-4827-9dc3-313a57c6a7a0 service nova] Creating event network-vif-plugged:78fc2089-0ff9-484b-bad9-e4a3a46fa4d0 for instance a77bc915-5eb5-4d31-85e1-812535fdbc66 on hv-cinder-83925 May 23 17:01:07.960168 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-022e096f-f60a-41f6-bcd3-066bb1456c7d req-bc7b52dd-5665-4827-9dc3-313a57c6a7a0 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029904 May 23 17:01:07.960977 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 544/1111] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 17:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:01:08.148251 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-30b1d5b0-66b0-4b40-951f-db2fd840f45b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:08.148927 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-30b1d5b0-66b0-4b40-951f-db2fd840f45b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:08.155571 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30b1d5b0-66b0-4b40-951f-db2fd840f45b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:08.155941 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30b1d5b0-66b0-4b40-951f-db2fd840f45b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:08.156771 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30b1d5b0-66b0-4b40-951f-db2fd840f45b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:08.157210 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-30b1d5b0-66b0-4b40-951f-db2fd840f45b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:08.295562 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-30b1d5b0-66b0-4b40-951f-db2fd840f45b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:08.303416 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-30b1d5b0-66b0-4b40-951f-db2fd840f45b tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1266 microversion: 2.1 time: 0.160290 May 23 17:01:08.303985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 568/1112] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:08 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:09.321965 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-18e7938d-a9e3-4d6a-9da9-e981bcd83959 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:09.322868 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-18e7938d-a9e3-4d6a-9da9-e981bcd83959 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:09.330059 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-18e7938d-a9e3-4d6a-9da9-e981bcd83959 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:09.330617 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-18e7938d-a9e3-4d6a-9da9-e981bcd83959 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:09.331418 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-18e7938d-a9e3-4d6a-9da9-e981bcd83959 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:09.331857 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-18e7938d-a9e3-4d6a-9da9-e981bcd83959 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:09.463166 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-18e7938d-a9e3-4d6a-9da9-e981bcd83959 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:09.470781 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-18e7938d-a9e3-4d6a-9da9-e981bcd83959 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1266 microversion: 2.1 time: 0.153602 May 23 17:01:09.471288 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 545/1113] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:09 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:01:10.488466 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-f99d460a-3abb-46d6-ba74-02fbdd3f6f4a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:10.489011 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-f99d460a-3abb-46d6-ba74-02fbdd3f6f4a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:10.495208 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f99d460a-3abb-46d6-ba74-02fbdd3f6f4a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:10.495670 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f99d460a-3abb-46d6-ba74-02fbdd3f6f4a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:10.496483 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f99d460a-3abb-46d6-ba74-02fbdd3f6f4a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:10.496933 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-f99d460a-3abb-46d6-ba74-02fbdd3f6f4a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:10.629169 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-f99d460a-3abb-46d6-ba74-02fbdd3f6f4a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:10.636713 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-f99d460a-3abb-46d6-ba74-02fbdd3f6f4a tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1453 microversion: 2.1 time: 0.153414 May 23 17:01:10.639920 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 569/1114] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:10 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:10.653617 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-672b21c2-995b-4533-a66b-936de26b1411 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:10.654246 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-672b21c2-995b-4533-a66b-936de26b1411 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:10.661167 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-672b21c2-995b-4533-a66b-936de26b1411 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:10.661629 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-672b21c2-995b-4533-a66b-936de26b1411 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:10.662392 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-672b21c2-995b-4533-a66b-936de26b1411 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:10.662836 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-672b21c2-995b-4533-a66b-936de26b1411 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:10.797421 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-672b21c2-995b-4533-a66b-936de26b1411 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:10.805646 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-672b21c2-995b-4533-a66b-936de26b1411 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1453 microversion: 2.1 time: 0.155898 May 23 17:01:10.806223 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 546/1115] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:10 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:13.119907 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-0a07cebc-2bad-40eb-8b1b-0f695af0f275 req-95c2a255-d3b0-4b5e-8bf9-1aa13a3814c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a77bc915-5eb5-4d31-85e1-812535fdbc66", "tag": "78fc2089-0ff9-484b-bad9-e4a3a46fa4d0"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:01:13.129548 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-0a07cebc-2bad-40eb-8b1b-0f695af0f275 req-95c2a255-d3b0-4b5e-8bf9-1aa13a3814c5 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:13.130014 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-0a07cebc-2bad-40eb-8b1b-0f695af0f275 req-95c2a255-d3b0-4b5e-8bf9-1aa13a3814c5 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:13.141385 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-0a07cebc-2bad-40eb-8b1b-0f695af0f275 req-95c2a255-d3b0-4b5e-8bf9-1aa13a3814c5 service nova] Creating event network-changed:78fc2089-0ff9-484b-bad9-e4a3a46fa4d0 for instance a77bc915-5eb5-4d31-85e1-812535fdbc66 on hv-cinder-83925 May 23 17:01:13.147853 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-0a07cebc-2bad-40eb-8b1b-0f695af0f275 req-95c2a255-d3b0-4b5e-8bf9-1aa13a3814c5 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031720 May 23 17:01:13.148490 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 570/1116] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 17:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:01:41.534460 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-536b5229-d439-4980-9a88-cc1b1d42aa86 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:01:41.535097 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-536b5229-d439-4980-9a88-cc1b1d42aa86 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:41.537320 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:01:41.537971 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=66 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:01:41.542705 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-536b5229-d439-4980-9a88-cc1b1d42aa86 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:41.543153 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-536b5229-d439-4980-9a88-cc1b1d42aa86 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:41.543908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-536b5229-d439-4980-9a88-cc1b1d42aa86 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:41.544394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-536b5229-d439-4980-9a88-cc1b1d42aa86 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:41.567755 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.objects.instance [None req-536b5229-d439-4980-9a88-cc1b1d42aa86 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lazy-loading 'flavor' on Instance uuid 925b5356-8e06-47f5-830f-74661c6f997f {{(pid=124714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:01:41.767104 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-536b5229-d439-4980-9a88-cc1b1d42aa86 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "POST /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f/action" status: 202 len: 0 microversion: 2.1 time: 0.236469 May 23 17:01:41.769700 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 547/1117] 10.222.0.74 () {60 vars in 1277 bytes} [Mon May 23 17:01:41 2022] POST /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:01:41.774009 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=26 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:01:41.774749 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=62 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:01:41.778775 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-d2620ff9-c78a-4c9f-8ebe-16ace1f54632 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:41.779509 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-d2620ff9-c78a-4c9f-8ebe-16ace1f54632 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:41.785776 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d2620ff9-c78a-4c9f-8ebe-16ace1f54632 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:41.786225 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d2620ff9-c78a-4c9f-8ebe-16ace1f54632 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:41.787029 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d2620ff9-c78a-4c9f-8ebe-16ace1f54632 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:41.787469 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d2620ff9-c78a-4c9f-8ebe-16ace1f54632 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:41.919149 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d2620ff9-c78a-4c9f-8ebe-16ace1f54632 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:41.926606 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-d2620ff9-c78a-4c9f-8ebe-16ace1f54632 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1568 microversion: 2.1 time: 0.154259 May 23 17:01:41.927178 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 571/1118] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:41 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:42.945804 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-28bf954f-d9e1-479b-a821-8f513fea24ac tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:42.946447 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-28bf954f-d9e1-479b-a821-8f513fea24ac tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:42.952943 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-28bf954f-d9e1-479b-a821-8f513fea24ac tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:42.953385 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-28bf954f-d9e1-479b-a821-8f513fea24ac tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:42.954170 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-28bf954f-d9e1-479b-a821-8f513fea24ac tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:42.954603 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-28bf954f-d9e1-479b-a821-8f513fea24ac tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:43.083649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-28bf954f-d9e1-479b-a821-8f513fea24ac tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:43.091263 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-28bf954f-d9e1-479b-a821-8f513fea24ac tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1568 microversion: 2.1 time: 0.151015 May 23 17:01:43.091844 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 548/1119] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:42 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:44.108842 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-d5ce0a0a-18ef-40fa-863d-1b386a7950fe tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:44.109439 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-d5ce0a0a-18ef-40fa-863d-1b386a7950fe tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:44.116026 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d5ce0a0a-18ef-40fa-863d-1b386a7950fe tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:44.116513 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d5ce0a0a-18ef-40fa-863d-1b386a7950fe tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:44.117279 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d5ce0a0a-18ef-40fa-863d-1b386a7950fe tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:44.117718 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-d5ce0a0a-18ef-40fa-863d-1b386a7950fe tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:44.250009 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-d5ce0a0a-18ef-40fa-863d-1b386a7950fe tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:44.257588 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-d5ce0a0a-18ef-40fa-863d-1b386a7950fe tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1568 microversion: 2.1 time: 0.152679 May 23 17:01:44.258154 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 572/1120] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:44 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:45.273771 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-121010a7-f86f-4758-aba7-af6fd8463a9e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:45.274389 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-121010a7-f86f-4758-aba7-af6fd8463a9e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:45.280904 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-121010a7-f86f-4758-aba7-af6fd8463a9e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:45.281357 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-121010a7-f86f-4758-aba7-af6fd8463a9e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:45.282123 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-121010a7-f86f-4758-aba7-af6fd8463a9e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:45.282566 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-121010a7-f86f-4758-aba7-af6fd8463a9e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:45.413409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-121010a7-f86f-4758-aba7-af6fd8463a9e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:45.421003 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-121010a7-f86f-4758-aba7-af6fd8463a9e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1568 microversion: 2.1 time: 0.151085 May 23 17:01:45.421579 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 549/1121] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:45 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:46.438975 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-47fc2e84-ad91-49ff-b08a-a93f02091405 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:46.439691 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-47fc2e84-ad91-49ff-b08a-a93f02091405 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:46.446819 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-47fc2e84-ad91-49ff-b08a-a93f02091405 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:46.447275 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-47fc2e84-ad91-49ff-b08a-a93f02091405 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:46.448047 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-47fc2e84-ad91-49ff-b08a-a93f02091405 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:46.448527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-47fc2e84-ad91-49ff-b08a-a93f02091405 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:46.583567 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-47fc2e84-ad91-49ff-b08a-a93f02091405 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:46.591105 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-47fc2e84-ad91-49ff-b08a-a93f02091405 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1568 microversion: 2.1 time: 0.156109 May 23 17:01:46.591665 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 573/1122] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:46 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:01:47.608099 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-61c31d34-f0cd-4402-894d-53f3efd701e3 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:47.608741 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-61c31d34-f0cd-4402-894d-53f3efd701e3 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:47.615771 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-61c31d34-f0cd-4402-894d-53f3efd701e3 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:47.616216 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-61c31d34-f0cd-4402-894d-53f3efd701e3 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:47.617004 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-61c31d34-f0cd-4402-894d-53f3efd701e3 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:47.617438 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-61c31d34-f0cd-4402-894d-53f3efd701e3 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:47.748814 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-61c31d34-f0cd-4402-894d-53f3efd701e3 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:47.756335 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-61c31d34-f0cd-4402-894d-53f3efd701e3 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1568 microversion: 2.1 time: 0.152058 May 23 17:01:47.756908 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 550/1123] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:47 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:48.773940 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-4a07cfab-1cdd-421b-9f59-06269328f462 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:48.774556 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-4a07cfab-1cdd-421b-9f59-06269328f462 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:48.780951 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4a07cfab-1cdd-421b-9f59-06269328f462 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:48.781425 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4a07cfab-1cdd-421b-9f59-06269328f462 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:48.782183 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4a07cfab-1cdd-421b-9f59-06269328f462 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:48.782618 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4a07cfab-1cdd-421b-9f59-06269328f462 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:48.911223 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-4a07cfab-1cdd-421b-9f59-06269328f462 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:48.918650 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-4a07cfab-1cdd-421b-9f59-06269328f462 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1568 microversion: 2.1 time: 0.149145 May 23 17:01:48.919214 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 574/1124] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:48 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:49.936454 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-c6de401b-d27a-4291-a4b5-a26fdb10086f tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:49.937077 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-c6de401b-d27a-4291-a4b5-a26fdb10086f tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:49.944280 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c6de401b-d27a-4291-a4b5-a26fdb10086f tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:49.944771 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c6de401b-d27a-4291-a4b5-a26fdb10086f tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:49.945539 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c6de401b-d27a-4291-a4b5-a26fdb10086f tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:49.946017 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-c6de401b-d27a-4291-a4b5-a26fdb10086f tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:50.078679 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-c6de401b-d27a-4291-a4b5-a26fdb10086f tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:50.086544 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-c6de401b-d27a-4291-a4b5-a26fdb10086f tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1568 microversion: 2.1 time: 0.154016 May 23 17:01:50.087111 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 551/1125] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:49 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:51.104251 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-897278ce-9ba8-4ec6-bcd8-d560b7a21917 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:51.104808 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-897278ce-9ba8-4ec6-bcd8-d560b7a21917 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:51.111187 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-897278ce-9ba8-4ec6-bcd8-d560b7a21917 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:51.111635 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-897278ce-9ba8-4ec6-bcd8-d560b7a21917 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:51.112457 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-897278ce-9ba8-4ec6-bcd8-d560b7a21917 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:51.112891 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-897278ce-9ba8-4ec6-bcd8-d560b7a21917 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:51.243775 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-897278ce-9ba8-4ec6-bcd8-d560b7a21917 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:51.251371 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-897278ce-9ba8-4ec6-bcd8-d560b7a21917 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1568 microversion: 2.1 time: 0.151070 May 23 17:01:51.252160 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 575/1126] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:51 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:52.269075 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-e75d611a-e877-4bce-9220-e482e653a63a tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:52.270376 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-e75d611a-e877-4bce-9220-e482e653a63a tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:52.277156 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e75d611a-e877-4bce-9220-e482e653a63a tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:52.277613 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e75d611a-e877-4bce-9220-e482e653a63a tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:52.278380 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e75d611a-e877-4bce-9220-e482e653a63a tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:52.278817 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-e75d611a-e877-4bce-9220-e482e653a63a tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:52.415372 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-e75d611a-e877-4bce-9220-e482e653a63a tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:52.422821 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-e75d611a-e877-4bce-9220-e482e653a63a tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1568 microversion: 2.1 time: 0.157608 May 23 17:01:52.423394 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 552/1127] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:52 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:53.440225 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-3ce31126-f93e-49d2-b5c6-023ce8edc84c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:53.440871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-3ce31126-f93e-49d2-b5c6-023ce8edc84c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:53.447750 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3ce31126-f93e-49d2-b5c6-023ce8edc84c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:53.448206 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3ce31126-f93e-49d2-b5c6-023ce8edc84c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:53.449007 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3ce31126-f93e-49d2-b5c6-023ce8edc84c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:53.449445 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-3ce31126-f93e-49d2-b5c6-023ce8edc84c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:53.578344 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-3ce31126-f93e-49d2-b5c6-023ce8edc84c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:53.585863 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-3ce31126-f93e-49d2-b5c6-023ce8edc84c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1568 microversion: 2.1 time: 0.149524 May 23 17:01:53.586431 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 576/1128] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:53 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:54.603201 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-f8175af3-95f7-4d0f-b3cb-190b672e1ba6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:54.603856 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-f8175af3-95f7-4d0f-b3cb-190b672e1ba6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:54.610061 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f8175af3-95f7-4d0f-b3cb-190b672e1ba6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:54.610514 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f8175af3-95f7-4d0f-b3cb-190b672e1ba6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:54.611281 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f8175af3-95f7-4d0f-b3cb-190b672e1ba6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:54.611725 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f8175af3-95f7-4d0f-b3cb-190b672e1ba6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:54.747513 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-f8175af3-95f7-4d0f-b3cb-190b672e1ba6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:54.755470 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-f8175af3-95f7-4d0f-b3cb-190b672e1ba6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1568 microversion: 2.1 time: 0.156686 May 23 17:01:54.755778 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 553/1129] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:54 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:55.772562 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-a57eff8b-a77c-406e-a0cb-221e80c73308 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:55.773163 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-a57eff8b-a77c-406e-a0cb-221e80c73308 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:55.779716 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a57eff8b-a77c-406e-a0cb-221e80c73308 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:55.780177 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a57eff8b-a77c-406e-a0cb-221e80c73308 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:55.780990 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a57eff8b-a77c-406e-a0cb-221e80c73308 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:55.781436 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-a57eff8b-a77c-406e-a0cb-221e80c73308 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:55.908089 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-a57eff8b-a77c-406e-a0cb-221e80c73308 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:55.916659 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-a57eff8b-a77c-406e-a0cb-221e80c73308 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1509 microversion: 2.1 time: 0.148064 May 23 17:01:55.917227 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 577/1130] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:55 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:55.933673 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-1746c092-1e4e-4665-a2e3-45e15ff44d1a tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:01:55.934248 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-1746c092-1e4e-4665-a2e3-45e15ff44d1a tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:55.940675 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1746c092-1e4e-4665-a2e3-45e15ff44d1a tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:55.941127 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1746c092-1e4e-4665-a2e3-45e15ff44d1a tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:55.941887 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1746c092-1e4e-4665-a2e3-45e15ff44d1a tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:55.942538 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-1746c092-1e4e-4665-a2e3-45e15ff44d1a tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:56.142336 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-1746c092-1e4e-4665-a2e3-45e15ff44d1a tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "POST /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f/action" status: 202 len: 0 microversion: 2.1 time: 0.212355 May 23 17:01:56.144334 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 554/1131] 10.222.0.74 () {60 vars in 1277 bytes} [Mon May 23 17:01:55 2022] POST /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:01:56.152276 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-6cff1ccd-08a4-4a0a-b4b4-1d90b01e191e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:56.152624 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-6cff1ccd-08a4-4a0a-b4b4-1d90b01e191e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:56.158576 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6cff1ccd-08a4-4a0a-b4b4-1d90b01e191e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:56.159031 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6cff1ccd-08a4-4a0a-b4b4-1d90b01e191e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:56.159815 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6cff1ccd-08a4-4a0a-b4b4-1d90b01e191e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:56.160259 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6cff1ccd-08a4-4a0a-b4b4-1d90b01e191e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:56.333760 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-6cff1ccd-08a4-4a0a-b4b4-1d90b01e191e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:56.341604 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-6cff1ccd-08a4-4a0a-b4b4-1d90b01e191e tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1517 microversion: 2.1 time: 0.193463 May 23 17:01:56.342209 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 578/1132] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:56 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1517 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:57.359862 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-82e39fd0-79e3-42e2-a73d-091c61b4b0d2 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:57.360483 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-82e39fd0-79e3-42e2-a73d-091c61b4b0d2 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:57.368352 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-82e39fd0-79e3-42e2-a73d-091c61b4b0d2 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:57.373873 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-82e39fd0-79e3-42e2-a73d-091c61b4b0d2 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:57.373873 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-82e39fd0-79e3-42e2-a73d-091c61b4b0d2 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:57.373873 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-82e39fd0-79e3-42e2-a73d-091c61b4b0d2 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:57.503682 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-82e39fd0-79e3-42e2-a73d-091c61b4b0d2 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:57.512073 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-82e39fd0-79e3-42e2-a73d-091c61b4b0d2 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1519 microversion: 2.1 time: 0.156265 May 23 17:01:57.513771 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 555/1133] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:57 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:57.935269 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-14f72040-1ecf-4cba-9313-71872adfed83 req-e43a06e8-854b-46f7-b7cb-a576fdc481f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "925b5356-8e06-47f5-830f-74661c6f997f", "name": "network-vif-unplugged", "status": "completed", "tag": "c3614cfe-7148-48d7-8938-8ee190885e3e"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:01:57.943923 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-14f72040-1ecf-4cba-9313-71872adfed83 req-e43a06e8-854b-46f7-b7cb-a576fdc481f1 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:57.944420 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-14f72040-1ecf-4cba-9313-71872adfed83 req-e43a06e8-854b-46f7-b7cb-a576fdc481f1 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:57.955612 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.compute.server_external_events [req-14f72040-1ecf-4cba-9313-71872adfed83 req-e43a06e8-854b-46f7-b7cb-a576fdc481f1 service nova] Unable to find a host for instance 925b5356-8e06-47f5-830f-74661c6f997f. Dropping event network-vif-unplugged {{(pid=124715) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 23 17:01:57.956521 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-14f72040-1ecf-4cba-9313-71872adfed83 req-e43a06e8-854b-46f7-b7cb-a576fdc481f1 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025146 May 23 17:01:57.957092 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 579/1134] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 17:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 23 17:01:58.531515 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-f5a4c0e0-3db1-4913-97bd-c7ce963d65d2 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:58.532333 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-f5a4c0e0-3db1-4913-97bd-c7ce963d65d2 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:58.540276 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f5a4c0e0-3db1-4913-97bd-c7ce963d65d2 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:58.540829 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f5a4c0e0-3db1-4913-97bd-c7ce963d65d2 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:58.541713 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f5a4c0e0-3db1-4913-97bd-c7ce963d65d2 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:58.542154 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f5a4c0e0-3db1-4913-97bd-c7ce963d65d2 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:58.679218 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-f5a4c0e0-3db1-4913-97bd-c7ce963d65d2 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:58.686827 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-f5a4c0e0-3db1-4913-97bd-c7ce963d65d2 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1575 microversion: 2.1 time: 0.159284 May 23 17:01:58.687398 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 556/1135] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:58 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:01:59.705292 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-4be0e866-a87c-4b95-b8b0-8317a87cd6ad tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:01:59.705915 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-4be0e866-a87c-4b95-b8b0-8317a87cd6ad tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:01:59.713509 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4be0e866-a87c-4b95-b8b0-8317a87cd6ad tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:59.713972 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4be0e866-a87c-4b95-b8b0-8317a87cd6ad tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:59.714748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4be0e866-a87c-4b95-b8b0-8317a87cd6ad tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:01:59.715193 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4be0e866-a87c-4b95-b8b0-8317a87cd6ad tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:01:59.844207 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-4be0e866-a87c-4b95-b8b0-8317a87cd6ad tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:01:59.851982 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-4be0e866-a87c-4b95-b8b0-8317a87cd6ad tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1575 microversion: 2.1 time: 0.150631 May 23 17:01:59.852599 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 580/1136] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:01:59 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:02:00.870128 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-dd81d06e-a4d4-4d58-b92c-0a022e0429d6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:02:00.870703 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-dd81d06e-a4d4-4d58-b92c-0a022e0429d6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:02:00.877313 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dd81d06e-a4d4-4d58-b92c-0a022e0429d6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:02:00.877770 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dd81d06e-a4d4-4d58-b92c-0a022e0429d6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:02:00.878543 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dd81d06e-a4d4-4d58-b92c-0a022e0429d6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:02:00.878989 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-dd81d06e-a4d4-4d58-b92c-0a022e0429d6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:02:01.015048 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-dd81d06e-a4d4-4d58-b92c-0a022e0429d6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:02:01.023320 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-dd81d06e-a4d4-4d58-b92c-0a022e0429d6 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1575 microversion: 2.1 time: 0.158210 May 23 17:02:01.023896 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 557/1137] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:02:00 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:02:02.040377 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-b0d9361b-122a-4d26-b274-e9439be91827 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:02:02.040985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-b0d9361b-122a-4d26-b274-e9439be91827 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:02:02.047516 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b0d9361b-122a-4d26-b274-e9439be91827 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:02:02.047964 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b0d9361b-122a-4d26-b274-e9439be91827 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:02:02.048761 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b0d9361b-122a-4d26-b274-e9439be91827 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:02:02.049199 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-b0d9361b-122a-4d26-b274-e9439be91827 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:02:02.177829 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-b0d9361b-122a-4d26-b274-e9439be91827 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:02:02.185314 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-b0d9361b-122a-4d26-b274-e9439be91827 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1575 microversion: 2.1 time: 0.148809 May 23 17:02:02.185885 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 581/1138] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:02:02 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:02:03.203105 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-9e3f835f-0983-40c3-b50f-4c057c69fb30 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:02:03.203718 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-9e3f835f-0983-40c3-b50f-4c057c69fb30 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:02:03.210366 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9e3f835f-0983-40c3-b50f-4c057c69fb30 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:02:03.210809 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9e3f835f-0983-40c3-b50f-4c057c69fb30 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:02:03.211600 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9e3f835f-0983-40c3-b50f-4c057c69fb30 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:02:03.212035 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-9e3f835f-0983-40c3-b50f-4c057c69fb30 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:02:03.345585 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-9e3f835f-0983-40c3-b50f-4c057c69fb30 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:02:03.353872 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-9e3f835f-0983-40c3-b50f-4c057c69fb30 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1575 microversion: 2.1 time: 0.154940 May 23 17:02:03.354471 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 558/1139] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:02:03 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:02:04.371809 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-6d4d9676-8d30-4ef0-a9d3-e547d0d89c07 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:02:04.372589 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-6d4d9676-8d30-4ef0-a9d3-e547d0d89c07 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:02:04.380330 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6d4d9676-8d30-4ef0-a9d3-e547d0d89c07 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:02:04.382274 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6d4d9676-8d30-4ef0-a9d3-e547d0d89c07 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:02:04.382912 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6d4d9676-8d30-4ef0-a9d3-e547d0d89c07 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:02:04.383671 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-6d4d9676-8d30-4ef0-a9d3-e547d0d89c07 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:02:04.525361 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-6d4d9676-8d30-4ef0-a9d3-e547d0d89c07 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:02:04.532997 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-6d4d9676-8d30-4ef0-a9d3-e547d0d89c07 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1575 microversion: 2.1 time: 0.165247 May 23 17:02:04.533564 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 582/1140] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:02:04 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:02:05.550932 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-3b6ab2a8-ce5e-4202-851a-f96c96e92b2c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:02:05.551580 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-3b6ab2a8-ce5e-4202-851a-f96c96e92b2c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:02:05.558667 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3b6ab2a8-ce5e-4202-851a-f96c96e92b2c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:02:05.559116 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3b6ab2a8-ce5e-4202-851a-f96c96e92b2c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:02:05.559881 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3b6ab2a8-ce5e-4202-851a-f96c96e92b2c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:02:05.560335 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-3b6ab2a8-ce5e-4202-851a-f96c96e92b2c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:02:05.691817 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-3b6ab2a8-ce5e-4202-851a-f96c96e92b2c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:02:05.700030 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-3b6ab2a8-ce5e-4202-851a-f96c96e92b2c tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1575 microversion: 2.1 time: 0.152659 May 23 17:02:05.700648 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 559/1141] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:02:05 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:02:06.718211 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-024fe790-4a45-4bce-8994-ba5c92d03d0d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:02:06.718852 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-024fe790-4a45-4bce-8994-ba5c92d03d0d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:02:06.725517 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-024fe790-4a45-4bce-8994-ba5c92d03d0d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:02:06.726030 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-024fe790-4a45-4bce-8994-ba5c92d03d0d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:02:06.727149 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-024fe790-4a45-4bce-8994-ba5c92d03d0d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:02:06.727598 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-024fe790-4a45-4bce-8994-ba5c92d03d0d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:02:06.864787 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-024fe790-4a45-4bce-8994-ba5c92d03d0d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:02:06.872939 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-024fe790-4a45-4bce-8994-ba5c92d03d0d tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1575 microversion: 2.1 time: 0.159064 May 23 17:02:06.873502 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 583/1142] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:02:06 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:02:07.890021 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-fb42e45d-d505-4302-9889-5af21a628544 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:02:07.890649 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-fb42e45d-d505-4302-9889-5af21a628544 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:02:07.897512 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fb42e45d-d505-4302-9889-5af21a628544 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:02:07.898501 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fb42e45d-d505-4302-9889-5af21a628544 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:02:07.899271 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fb42e45d-d505-4302-9889-5af21a628544 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:02:07.899705 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-fb42e45d-d505-4302-9889-5af21a628544 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:02:07.918642 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:02:08.034403 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-fb42e45d-d505-4302-9889-5af21a628544 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:02:08.042921 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-fb42e45d-d505-4302-9889-5af21a628544 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1575 microversion: 2.1 time: 0.156752 May 23 17:02:08.043533 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 560/1143] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:02:07 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:02:09.060147 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-03b9d0e9-5934-490d-99ca-303cf0cf4d62 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:02:09.060753 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-03b9d0e9-5934-490d-99ca-303cf0cf4d62 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:02:09.067336 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-03b9d0e9-5934-490d-99ca-303cf0cf4d62 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:02:09.070324 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-03b9d0e9-5934-490d-99ca-303cf0cf4d62 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:02:09.070324 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-03b9d0e9-5934-490d-99ca-303cf0cf4d62 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:02:09.070324 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-03b9d0e9-5934-490d-99ca-303cf0cf4d62 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:02:09.202909 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-03b9d0e9-5934-490d-99ca-303cf0cf4d62 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:02:09.210383 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-03b9d0e9-5934-490d-99ca-303cf0cf4d62 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1575 microversion: 2.1 time: 0.154177 May 23 17:02:09.210953 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 584/1144] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:02:09 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:02:10.004233 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-191a827e-385b-49d5-b067-471fedbd0fb2 req-ea54d37b-fe98-4c27-b223-685254ac5320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "925b5356-8e06-47f5-830f-74661c6f997f", "name": "network-vif-plugged", "status": "completed", "tag": "c3614cfe-7148-48d7-8938-8ee190885e3e"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:02:10.013472 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-191a827e-385b-49d5-b067-471fedbd0fb2 req-ea54d37b-fe98-4c27-b223-685254ac5320 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:02:10.013932 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-191a827e-385b-49d5-b067-471fedbd0fb2 req-ea54d37b-fe98-4c27-b223-685254ac5320 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:02:10.025426 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-191a827e-385b-49d5-b067-471fedbd0fb2 req-ea54d37b-fe98-4c27-b223-685254ac5320 service nova] Creating event network-vif-plugged:c3614cfe-7148-48d7-8938-8ee190885e3e for instance 925b5356-8e06-47f5-830f-74661c6f997f on hv-cinder-83925 May 23 17:02:10.030593 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-191a827e-385b-49d5-b067-471fedbd0fb2 req-ea54d37b-fe98-4c27-b223-685254ac5320 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030068 May 23 17:02:10.031183 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 561/1145] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 17:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:02:10.227078 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-2d4b48b9-ce97-4447-915d-566aa4d0f658 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:02:10.227699 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-2d4b48b9-ce97-4447-915d-566aa4d0f658 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:02:10.234310 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2d4b48b9-ce97-4447-915d-566aa4d0f658 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:02:10.234763 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2d4b48b9-ce97-4447-915d-566aa4d0f658 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:02:10.235535 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2d4b48b9-ce97-4447-915d-566aa4d0f658 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:02:10.235982 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-2d4b48b9-ce97-4447-915d-566aa4d0f658 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:02:10.370152 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-2d4b48b9-ce97-4447-915d-566aa4d0f658 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:02:10.377774 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-2d4b48b9-ce97-4447-915d-566aa4d0f658 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1575 microversion: 2.1 time: 0.154705 May 23 17:02:10.378348 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 585/1146] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:02:10 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:02:11.396492 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-a577f3be-c84b-4de7-9ac7-cbbea682d8bb tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:02:11.397209 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-a577f3be-c84b-4de7-9ac7-cbbea682d8bb tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:02:11.405302 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a577f3be-c84b-4de7-9ac7-cbbea682d8bb tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:02:11.405759 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a577f3be-c84b-4de7-9ac7-cbbea682d8bb tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:02:11.406530 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a577f3be-c84b-4de7-9ac7-cbbea682d8bb tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:02:11.406979 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-a577f3be-c84b-4de7-9ac7-cbbea682d8bb tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:02:11.542310 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-a577f3be-c84b-4de7-9ac7-cbbea682d8bb tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:02:11.549971 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-a577f3be-c84b-4de7-9ac7-cbbea682d8bb tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1575 microversion: 2.1 time: 0.157731 May 23 17:02:11.550604 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 562/1147] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:02:11 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:02:12.567492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-89ecbf23-d83c-42b0-9a09-88234703a104 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:02:12.568192 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-89ecbf23-d83c-42b0-9a09-88234703a104 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:02:12.572355 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=31 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:02:12.575771 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-89ecbf23-d83c-42b0-9a09-88234703a104 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:02:12.576222 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-89ecbf23-d83c-42b0-9a09-88234703a104 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:02:12.577028 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-89ecbf23-d83c-42b0-9a09-88234703a104 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:02:12.577517 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-89ecbf23-d83c-42b0-9a09-88234703a104 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:02:12.580170 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=87 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:02:12.713049 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-89ecbf23-d83c-42b0-9a09-88234703a104 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:02:12.720611 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-89ecbf23-d83c-42b0-9a09-88234703a104 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1562 microversion: 2.1 time: 0.157067 May 23 17:02:12.721192 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 586/1148] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:02:12 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:03:03.290473 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-45adf824-265f-43f5-9651-7ea56c276b78 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:03:03.291031 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-45adf824-265f-43f5-9651-7ea56c276b78 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:03:03.293741 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=34 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:03.294114 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:03.294525 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=10 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:03.295050 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=5 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:03.299824 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-45adf824-265f-43f5-9651-7ea56c276b78 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:03.300289 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-45adf824-265f-43f5-9651-7ea56c276b78 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:03.301242 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-45adf824-265f-43f5-9651-7ea56c276b78 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:03.301739 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-45adf824-265f-43f5-9651-7ea56c276b78 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:03.329967 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-45adf824-265f-43f5-9651-7ea56c276b78 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Going to try to terminate instance {{(pid=124714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:03:03.366872 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-f8d7d223-6bd0-40f8-b57a-dbe6b8c3d30d req-69a3e08b-34e8-49d4-bae0-f307e7353b8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a77bc915-5eb5-4d31-85e1-812535fdbc66", "tag": "78fc2089-0ff9-484b-bad9-e4a3a46fa4d0"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:03:03.375333 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-f8d7d223-6bd0-40f8-b57a-dbe6b8c3d30d req-69a3e08b-34e8-49d4-bae0-f307e7353b8d service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:03.375871 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-f8d7d223-6bd0-40f8-b57a-dbe6b8c3d30d req-69a3e08b-34e8-49d4-bae0-f307e7353b8d service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:03.388031 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-f8d7d223-6bd0-40f8-b57a-dbe6b8c3d30d req-69a3e08b-34e8-49d4-bae0-f307e7353b8d service nova] Creating event network-changed:78fc2089-0ff9-484b-bad9-e4a3a46fa4d0 for instance a77bc915-5eb5-4d31-85e1-812535fdbc66 on hv-cinder-83925 May 23 17:03:03.393350 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-f8d7d223-6bd0-40f8-b57a-dbe6b8c3d30d req-69a3e08b-34e8-49d4-bae0-f307e7353b8d service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104180 May 23 17:03:03.393910 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 587/1149] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 17:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:03:03.659467 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-45adf824-265f-43f5-9651-7ea56c276b78 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "DELETE /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 204 len: 0 microversion: 2.1 time: 0.374040 May 23 17:03:03.660573 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 563/1150] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 17:03:03 2022] DELETE /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 17:03:03.669990 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-47a61c08-4167-4a6d-acb6-73604964092f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:03:03.670796 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-47a61c08-4167-4a6d-acb6-73604964092f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:03:03.677767 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-47a61c08-4167-4a6d-acb6-73604964092f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:03.678230 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-47a61c08-4167-4a6d-acb6-73604964092f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:03.679926 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-47a61c08-4167-4a6d-acb6-73604964092f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:03.680829 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-47a61c08-4167-4a6d-acb6-73604964092f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:03.820184 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-47a61c08-4167-4a6d-acb6-73604964092f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:03:03.827994 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-47a61c08-4167-4a6d-acb6-73604964092f tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1578 microversion: 2.1 time: 0.162668 May 23 17:03:03.832879 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 588/1151] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:03:03 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:03:04.849365 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-35d1892b-a711-4249-acd6-fffbd91d80eb tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:03:04.849971 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-35d1892b-a711-4249-acd6-fffbd91d80eb tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:03:04.858176 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-35d1892b-a711-4249-acd6-fffbd91d80eb tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:04.858962 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-35d1892b-a711-4249-acd6-fffbd91d80eb tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:04.859886 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-35d1892b-a711-4249-acd6-fffbd91d80eb tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:04.860346 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-35d1892b-a711-4249-acd6-fffbd91d80eb tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:05.008115 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-35d1892b-a711-4249-acd6-fffbd91d80eb tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:03:05.016284 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-35d1892b-a711-4249-acd6-fffbd91d80eb tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1578 microversion: 2.1 time: 0.171304 May 23 17:03:05.016882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 564/1152] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:03:04 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:03:05.949051 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-3a4edcfa-e7c5-48a8-95ba-03889434d399 req-2a4b4621-5f4f-4fa6-a78f-df3fa768dff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a77bc915-5eb5-4d31-85e1-812535fdbc66", "name": "network-vif-deleted", "tag": "78fc2089-0ff9-484b-bad9-e4a3a46fa4d0"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:03:05.957656 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-3a4edcfa-e7c5-48a8-95ba-03889434d399 req-2a4b4621-5f4f-4fa6-a78f-df3fa768dff8 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:05.958394 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-3a4edcfa-e7c5-48a8-95ba-03889434d399 req-2a4b4621-5f4f-4fa6-a78f-df3fa768dff8 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:05.969022 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-3a4edcfa-e7c5-48a8-95ba-03889434d399 req-2a4b4621-5f4f-4fa6-a78f-df3fa768dff8 service nova] Creating event network-vif-deleted:78fc2089-0ff9-484b-bad9-e4a3a46fa4d0 for instance a77bc915-5eb5-4d31-85e1-812535fdbc66 on hv-cinder-83925 May 23 17:03:05.974318 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-3a4edcfa-e7c5-48a8-95ba-03889434d399 req-2a4b4621-5f4f-4fa6-a78f-df3fa768dff8 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029954 May 23 17:03:05.975053 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 589/1153] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 17:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:03:06.035732 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-f8c1f163-5050-477e-97dc-d8ff133edc82 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:03:06.036400 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-f8c1f163-5050-477e-97dc-d8ff133edc82 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:03:06.043679 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f8c1f163-5050-477e-97dc-d8ff133edc82 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:06.044146 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f8c1f163-5050-477e-97dc-d8ff133edc82 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:06.045083 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f8c1f163-5050-477e-97dc-d8ff133edc82 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:06.045523 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-f8c1f163-5050-477e-97dc-d8ff133edc82 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:06.113233 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-f8c1f163-5050-477e-97dc-d8ff133edc82 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:03:06.121684 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-f8c1f163-5050-477e-97dc-d8ff133edc82 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1391 microversion: 2.1 time: 0.089977 May 23 17:03:06.122267 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 565/1154] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:03:06 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1391 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:03:07.139555 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-4ee65fa2-e845-4283-8447-b25e4ba2b754 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:03:07.140380 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-4ee65fa2-e845-4283-8447-b25e4ba2b754 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:03:07.147034 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4ee65fa2-e845-4283-8447-b25e4ba2b754 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:07.147492 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4ee65fa2-e845-4283-8447-b25e4ba2b754 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:07.148438 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4ee65fa2-e845-4283-8447-b25e4ba2b754 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:07.148923 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4ee65fa2-e845-4283-8447-b25e4ba2b754 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:07.181777 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4ee65fa2-e845-4283-8447-b25e4ba2b754 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:07.182228 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-4ee65fa2-e845-4283-8447-b25e4ba2b754 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:07.182674 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.objects.instance [None req-4ee65fa2-e845-4283-8447-b25e4ba2b754 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lazy-loading 'fault' on Instance uuid a77bc915-5eb5-4d31-85e1-812535fdbc66 {{(pid=124715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:03:07.226546 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-4ee65fa2-e845-4283-8447-b25e4ba2b754 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:03:07.233643 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-4ee65fa2-e845-4283-8447-b25e4ba2b754 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 200 len: 1184 microversion: 2.1 time: 0.098505 May 23 17:03:07.234223 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 590/1155] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:03:07 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 1184 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:03:08.253165 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-d3942248-3879-47f8-a863-0dd3d3e25307 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:03:08.253718 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-d3942248-3879-47f8-a863-0dd3d3e25307 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: a77bc915-5eb5-4d31-85e1-812535fdbc66] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:03:08.260900 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d3942248-3879-47f8-a863-0dd3d3e25307 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:08.261343 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d3942248-3879-47f8-a863-0dd3d3e25307 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:08.262100 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d3942248-3879-47f8-a863-0dd3d3e25307 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:08.262532 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-d3942248-3879-47f8-a863-0dd3d3e25307 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:08.276346 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-d3942248-3879-47f8-a863-0dd3d3e25307 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] HTTP exception thrown: Instance a77bc915-5eb5-4d31-85e1-812535fdbc66 could not be found. May 23 17:03:08.277963 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-d3942248-3879-47f8-a863-0dd3d3e25307 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Request method failure captured: May 23 17:03:08.277963 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 HTTP/1.1 May 23 17:03:08.277963 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 17:03:08.277963 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 17:03:08.277963 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 17:03:08.277963 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 17:03:08.277963 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 17:03:08.277963 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 17:03:08.277963 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 17:03:08.277963 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 17:03:08.277963 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7xBrV4MjFQh51j4dPvJWSwFpw9CUbC49y-llzMB8Abn5LWu0gl2XpNIPHXBBG8AW61v_eaHkKQumxXQe5ZAM2zmHFTjIw_fBD--b9MfK81l987usOgVabVAT5Uj5BFtUIWTwtdJGrJFRxvzrM5GVBHx1tt3O3LXuh_R-aV7OWRFItQ May 23 17:03:08.277963 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 17:03:08.277963 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 17:03:08.277963 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 17:03:08.277963 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 17:03:08.277963 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 17:03:08.277963 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 17:03:08.277963 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: 8d09d9819e564152aacc661d1da68fcd May 23 17:03:08.277963 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-TestVolumeBootPattern-528381394 May 23 17:03:08.277963 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 17:03:08.277963 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 17:03:08.279795 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8d09d9819e564152aacc661d1da68fcd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8d09d9819e564152aacc661d1da68fcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8d09d9819e564152aacc661d1da68fcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8d09d9819e564152aacc661d1da68fcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 17:03:08.279795 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-TestVolumeBootPattern-528381394 May 23 17:03:08.279795 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: 8d09d9819e564152aacc661d1da68fcd May 23 17:03:08.279795 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-TestVolumeBootPattern-528381394 May 23 17:03:08.279795 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-TestVolumeBootPattern-528381394-project May 23 17:03:08.279795 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 17:03:08.279795 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 17:03:08.279795 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 2aa01ac54736475188dbc47f3cda4de1 May 23 17:03:08.279795 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-TestVolumeBootPattern-528381394-project May 23 17:03:08.279795 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: > May 23 17:03:08.279795 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Instance a77bc915-5eb5-4d31-85e1-812535fdbc66 could not be found. May 23 17:03:08.279795 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': 'a77bc915-5eb5-4d31-85e1-812535fdbc66'} May 23 17:03:08.280882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:03:08.280882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:03:08.280882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:03:08.280882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:03:08.280882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:03:08.280882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:03:08.280882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:03:08.280882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:03:08.280882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:03:08.280882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:03:08.280882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a77bc915-5eb5-4d31-85e1-812535fdbc66 could not be found. May 23 17:03:08.280882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 17:03:08.280882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:03:08.280882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 17:03:08.280882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:03:08.280882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:03:08.280882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:03:08.280882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:03:08.280882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:03:08.280882 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:03:08.282742 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:03:08.282742 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:03:08.282742 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:03:08.282742 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:03:08.282742 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:03:08.282742 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:03:08.282742 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:03:08.282742 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a77bc915-5eb5-4d31-85e1-812535fdbc66 could not be found. May 23 17:03:08.282742 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 17:03:08.282742 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:03:08.282742 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 17:03:08.282742 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:03:08.282742 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:03:08.282742 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:03:08.282742 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:03:08.282742 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:03:08.282742 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a77bc915-5eb5-4d31-85e1-812535fdbc66 could not be found. May 23 17:03:08.282742 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 17:03:08.284256 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-d3942248-3879-47f8-a863-0dd3d3e25307 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Returning 404 to user: Instance a77bc915-5eb5-4d31-85e1-812535fdbc66 could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:03:08.284256 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-d3942248-3879-47f8-a863-0dd3d3e25307 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66" status: 404 len: 111 microversion: 2.1 time: 0.030078 May 23 17:03:08.284256 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 566/1156] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:03:08 2022] GET /compute/v2.1/servers/a77bc915-5eb5-4d31-85e1-812535fdbc66 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:03:11.752802 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-63d0653b-97f0-49fa-920b-f7ca655d5de4 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:03:11.753354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-63d0653b-97f0-49fa-920b-f7ca655d5de4 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:03:11.753836 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-370692d0-c904-4dd0-ab35-9bfbabd58bda req-b6ac6129-71a4-4503-9fa2-b62548646504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d1af3a9-42b0-46e8-8c63-55256f645d1a", "tag": "5875fa7e-540a-4b73-b6a6-d251f8408804"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:03:11.760527 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-63d0653b-97f0-49fa-920b-f7ca655d5de4 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:11.760982 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-63d0653b-97f0-49fa-920b-f7ca655d5de4 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:11.761746 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-63d0653b-97f0-49fa-920b-f7ca655d5de4 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:11.762368 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-63d0653b-97f0-49fa-920b-f7ca655d5de4 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:11.763944 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-370692d0-c904-4dd0-ab35-9bfbabd58bda req-b6ac6129-71a4-4503-9fa2-b62548646504 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:11.764504 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-370692d0-c904-4dd0-ab35-9bfbabd58bda req-b6ac6129-71a4-4503-9fa2-b62548646504 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:11.776197 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-370692d0-c904-4dd0-ab35-9bfbabd58bda req-b6ac6129-71a4-4503-9fa2-b62548646504 service nova] Creating event network-changed:5875fa7e-540a-4b73-b6a6-d251f8408804 for instance 8d1af3a9-42b0-46e8-8c63-55256f645d1a on hv-cinder-83925 May 23 17:03:11.781494 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-370692d0-c904-4dd0-ab35-9bfbabd58bda req-b6ac6129-71a4-4503-9fa2-b62548646504 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031456 May 23 17:03:11.782624 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 567/1157] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 17:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:03:11.794476 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-63d0653b-97f0-49fa-920b-f7ca655d5de4 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Going to try to terminate instance {{(pid=124715) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:03:12.094517 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-63d0653b-97f0-49fa-920b-f7ca655d5de4 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "DELETE /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 204 len: 0 microversion: 2.1 time: 0.346128 May 23 17:03:12.103639 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-6fa2c7d3-ddd8-439c-a219-85a0cd4a7476 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:03:12.103932 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 591/1158] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 17:03:11 2022] DELETE /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 17:03:12.104723 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-6fa2c7d3-ddd8-439c-a219-85a0cd4a7476 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:03:12.111242 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6fa2c7d3-ddd8-439c-a219-85a0cd4a7476 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:12.111753 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6fa2c7d3-ddd8-439c-a219-85a0cd4a7476 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:12.112596 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6fa2c7d3-ddd8-439c-a219-85a0cd4a7476 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:12.113041 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-6fa2c7d3-ddd8-439c-a219-85a0cd4a7476 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:12.250224 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-6fa2c7d3-ddd8-439c-a219-85a0cd4a7476 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:03:12.258475 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-6fa2c7d3-ddd8-439c-a219-85a0cd4a7476 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 200 len: 1576 microversion: 2.1 time: 0.159148 May 23 17:03:12.259044 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 568/1159] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:03:12 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:03:13.277543 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7e177d46-a1e0-45a2-85bf-452a16f08048 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:03:13.289080 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-7e177d46-a1e0-45a2-85bf-452a16f08048 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:03:13.289080 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7e177d46-a1e0-45a2-85bf-452a16f08048 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:13.289080 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7e177d46-a1e0-45a2-85bf-452a16f08048 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:13.289080 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7e177d46-a1e0-45a2-85bf-452a16f08048 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:13.289705 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7e177d46-a1e0-45a2-85bf-452a16f08048 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:13.423156 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-7e177d46-a1e0-45a2-85bf-452a16f08048 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:03:13.431110 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-7e177d46-a1e0-45a2-85bf-452a16f08048 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 200 len: 1457 microversion: 2.1 time: 0.158745 May 23 17:03:13.431682 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 592/1160] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:03:13 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 1457 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:03:14.100967 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [req-42dc0cd9-c1fa-4f56-bd6e-e03340597a06 req-b0ccee93-bb2b-4e78-b4f7-ea848c1bb0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d1af3a9-42b0-46e8-8c63-55256f645d1a", "name": "network-vif-deleted", "tag": "5875fa7e-540a-4b73-b6a6-d251f8408804"}]} {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:03:14.109754 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-42dc0cd9-c1fa-4f56-bd6e-e03340597a06 req-b0ccee93-bb2b-4e78-b4f7-ea848c1bb0c7 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:14.114259 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [req-42dc0cd9-c1fa-4f56-bd6e-e03340597a06 req-b0ccee93-bb2b-4e78-b4f7-ea848c1bb0c7 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:14.122044 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.compute.server_external_events [req-42dc0cd9-c1fa-4f56-bd6e-e03340597a06 req-b0ccee93-bb2b-4e78-b4f7-ea848c1bb0c7 service nova] Creating event network-vif-deleted:5875fa7e-540a-4b73-b6a6-d251f8408804 for instance 8d1af3a9-42b0-46e8-8c63-55256f645d1a on hv-cinder-83925 May 23 17:03:14.127692 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [req-42dc0cd9-c1fa-4f56-bd6e-e03340597a06 req-b0ccee93-bb2b-4e78-b4f7-ea848c1bb0c7 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030508 May 23 17:03:14.128228 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 569/1161] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 17:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:03:14.449047 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-56d17956-fcbe-4ae2-9c28-f153fa3ef499 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:03:14.449764 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-56d17956-fcbe-4ae2-9c28-f153fa3ef499 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:03:14.456671 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-56d17956-fcbe-4ae2-9c28-f153fa3ef499 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:14.457122 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-56d17956-fcbe-4ae2-9c28-f153fa3ef499 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:14.457907 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-56d17956-fcbe-4ae2-9c28-f153fa3ef499 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:14.458410 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-56d17956-fcbe-4ae2-9c28-f153fa3ef499 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:14.540031 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-56d17956-fcbe-4ae2-9c28-f153fa3ef499 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa01ac54736475188dbc47f3cda4de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d09d9819e564152aacc661d1da68fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:03:14.547631 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-56d17956-fcbe-4ae2-9c28-f153fa3ef499 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 200 len: 1223 microversion: 2.1 time: 0.103312 May 23 17:03:14.548203 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 593/1162] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:03:14 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:03:15.566332 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-558b5081-fb7a-4f57-94ae-9f0af0f61c44 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:03:15.567039 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-558b5081-fb7a-4f57-94ae-9f0af0f61c44 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 8d1af3a9-42b0-46e8-8c63-55256f645d1a] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:03:15.574279 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-558b5081-fb7a-4f57-94ae-9f0af0f61c44 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:15.574731 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-558b5081-fb7a-4f57-94ae-9f0af0f61c44 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:15.575494 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-558b5081-fb7a-4f57-94ae-9f0af0f61c44 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:15.575955 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-558b5081-fb7a-4f57-94ae-9f0af0f61c44 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:15.589207 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-558b5081-fb7a-4f57-94ae-9f0af0f61c44 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] HTTP exception thrown: Instance 8d1af3a9-42b0-46e8-8c63-55256f645d1a could not be found. May 23 17:03:15.590773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-558b5081-fb7a-4f57-94ae-9f0af0f61c44 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Request method failure captured: May 23 17:03:15.590773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a HTTP/1.1 May 23 17:03:15.590773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 17:03:15.590773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 17:03:15.590773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 17:03:15.590773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 17:03:15.590773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 17:03:15.590773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 17:03:15.590773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 17:03:15.590773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 17:03:15.590773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7xBrV4MjFQh51j4dPvJWSwFpw9CUbC49y-llzMB8Abn5LWu0gl2XpNIPHXBBG8AW61v_eaHkKQumxXQe5ZAM2zmHFTjIw_fBD--b9MfK81l987usOgVabVAT5Uj5BFtUIWTwtdJGrJFRxvzrM5GVBHx1tt3O3LXuh_R-aV7OWRFItQ May 23 17:03:15.590773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 17:03:15.590773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 17:03:15.590773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 17:03:15.590773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 17:03:15.590773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 17:03:15.590773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 17:03:15.590773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: 8d09d9819e564152aacc661d1da68fcd May 23 17:03:15.590773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-TestVolumeBootPattern-528381394 May 23 17:03:15.590773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 17:03:15.590773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 17:03:15.592622 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8d09d9819e564152aacc661d1da68fcd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8d09d9819e564152aacc661d1da68fcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8d09d9819e564152aacc661d1da68fcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8d09d9819e564152aacc661d1da68fcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 17:03:15.592622 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-TestVolumeBootPattern-528381394 May 23 17:03:15.592622 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: 8d09d9819e564152aacc661d1da68fcd May 23 17:03:15.592622 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-TestVolumeBootPattern-528381394 May 23 17:03:15.592622 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-TestVolumeBootPattern-528381394-project May 23 17:03:15.592622 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 17:03:15.592622 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 17:03:15.592622 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 2aa01ac54736475188dbc47f3cda4de1 May 23 17:03:15.592622 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-TestVolumeBootPattern-528381394-project May 23 17:03:15.592622 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: > May 23 17:03:15.592622 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Instance 8d1af3a9-42b0-46e8-8c63-55256f645d1a could not be found. May 23 17:03:15.592622 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': '8d1af3a9-42b0-46e8-8c63-55256f645d1a'} May 23 17:03:15.593875 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:03:15.593875 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:03:15.593875 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:03:15.593875 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:03:15.593875 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:03:15.593875 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:03:15.593875 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:03:15.593875 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:03:15.593875 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:03:15.593875 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:03:15.593875 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d1af3a9-42b0-46e8-8c63-55256f645d1a could not be found. May 23 17:03:15.593875 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 17:03:15.593875 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:03:15.593875 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 17:03:15.593875 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:03:15.593875 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:03:15.593875 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:03:15.593875 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:03:15.593875 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:03:15.593875 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:03:15.595727 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:03:15.595727 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:03:15.595727 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:03:15.595727 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:03:15.595727 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:03:15.595727 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:03:15.595727 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:03:15.595727 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d1af3a9-42b0-46e8-8c63-55256f645d1a could not be found. May 23 17:03:15.595727 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 17:03:15.595727 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:03:15.595727 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 17:03:15.595727 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:03:15.595727 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:03:15.595727 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:03:15.595727 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:03:15.595727 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:03:15.595727 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d1af3a9-42b0-46e8-8c63-55256f645d1a could not be found. May 23 17:03:15.595727 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 17:03:15.597375 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-558b5081-fb7a-4f57-94ae-9f0af0f61c44 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Returning 404 to user: Instance 8d1af3a9-42b0-46e8-8c63-55256f645d1a could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:03:15.597375 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-558b5081-fb7a-4f57-94ae-9f0af0f61c44 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a" status: 404 len: 111 microversion: 2.1 time: 0.030581 May 23 17:03:15.597375 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 570/1163] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:03:15 2022] GET /compute/v2.1/servers/8d1af3a9-42b0-46e8-8c63-55256f645d1a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:03:16.107054 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c4ae32e9-a5e8-406d-a450-9168e9392992 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:03:16.107576 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-c4ae32e9-a5e8-406d-a450-9168e9392992 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:03:16.114039 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c4ae32e9-a5e8-406d-a450-9168e9392992 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:16.114485 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c4ae32e9-a5e8-406d-a450-9168e9392992 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:16.115245 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c4ae32e9-a5e8-406d-a450-9168e9392992 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:16.115677 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-c4ae32e9-a5e8-406d-a450-9168e9392992 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:16.128684 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-c4ae32e9-a5e8-406d-a450-9168e9392992 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] HTTP exception thrown: Instance 5e461f9e-4217-45ec-bf28-2a70f7ca0f82 could not be found. May 23 17:03:16.130354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c4ae32e9-a5e8-406d-a450-9168e9392992 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Request method failure captured: May 23 17:03:16.130354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: DELETE /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 HTTP/1.1 May 23 17:03:16.130354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 17:03:16.130354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 17:03:16.130354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 17:03:16.130354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 17:03:16.130354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 17:03:16.130354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 17:03:16.130354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 17:03:16.130354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 17:03:16.130354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii7xBrV4MjFQh51j4dPvJWSwFpw9CUbC49y-llzMB8Abn5LWu0gl2XpNIPHXBBG8AW61v_eaHkKQumxXQe5ZAM2zmHFTjIw_fBD--b9MfK81l987usOgVabVAT5Uj5BFtUIWTwtdJGrJFRxvzrM5GVBHx1tt3O3LXuh_R-aV7OWRFItQ May 23 17:03:16.130354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 17:03:16.130354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 17:03:16.130354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 17:03:16.130354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 17:03:16.130354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 17:03:16.130354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 17:03:16.130354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: 8d09d9819e564152aacc661d1da68fcd May 23 17:03:16.130354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-TestVolumeBootPattern-528381394 May 23 17:03:16.130354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 17:03:16.130354 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 17:03:16.132212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8d09d9819e564152aacc661d1da68fcd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8d09d9819e564152aacc661d1da68fcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8d09d9819e564152aacc661d1da68fcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8d09d9819e564152aacc661d1da68fcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 17:03:16.132212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-TestVolumeBootPattern-528381394 May 23 17:03:16.132212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: 8d09d9819e564152aacc661d1da68fcd May 23 17:03:16.132212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-TestVolumeBootPattern-528381394 May 23 17:03:16.132212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-TestVolumeBootPattern-528381394-project May 23 17:03:16.132212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 17:03:16.132212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 17:03:16.132212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: 2aa01ac54736475188dbc47f3cda4de1 May 23 17:03:16.132212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-TestVolumeBootPattern-528381394-project May 23 17:03:16.132212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 17:03:16.132212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Instance 5e461f9e-4217-45ec-bf28-2a70f7ca0f82 could not be found. May 23 17:03:16.132212 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': '5e461f9e-4217-45ec-bf28-2a70f7ca0f82'} May 23 17:03:16.133140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:03:16.133140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:03:16.133140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:03:16.133140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:03:16.133140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:03:16.133140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:03:16.133140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:03:16.133140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:03:16.133140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:03:16.133140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:03:16.133140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e461f9e-4217-45ec-bf28-2a70f7ca0f82 could not be found. May 23 17:03:16.133140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 17:03:16.133140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:03:16.133140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 17:03:16.133140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:03:16.133140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:03:16.133140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:03:16.133140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:03:16.133140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:03:16.133140 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:03:16.134532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:03:16.134532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 17:03:16.134532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 17:03:16.134532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 17:03:16.134532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 17:03:16.134532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:03:16.134532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:03:16.134532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:03:16.134532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:03:16.134532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e461f9e-4217-45ec-bf28-2a70f7ca0f82 could not be found. May 23 17:03:16.134532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 17:03:16.134532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:03:16.134532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 17:03:16.134532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:03:16.134532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:03:16.134532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:03:16.134532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:03:16.134532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:03:16.134532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e461f9e-4217-45ec-bf28-2a70f7ca0f82 could not be found. May 23 17:03:16.134532 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 17:03:16.136192 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-c4ae32e9-a5e8-406d-a450-9168e9392992 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Returning 404 to user: Instance 5e461f9e-4217-45ec-bf28-2a70f7ca0f82 could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:03:16.136192 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-c4ae32e9-a5e8-406d-a450-9168e9392992 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "DELETE /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 404 len: 111 microversion: 2.1 time: 0.028702 May 23 17:03:16.136192 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 594/1164] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 17:03:16 2022] DELETE /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:03:16.141494 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ab439e33-c3ba-4068-a3e1-54571baa3a5c tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:03:16.142116 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-ab439e33-c3ba-4068-a3e1-54571baa3a5c tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] [instance: 5e461f9e-4217-45ec-bf28-2a70f7ca0f82] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:03:16.148881 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ab439e33-c3ba-4068-a3e1-54571baa3a5c tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:16.149335 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ab439e33-c3ba-4068-a3e1-54571baa3a5c tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:16.150109 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ab439e33-c3ba-4068-a3e1-54571baa3a5c tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:16.150546 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-ab439e33-c3ba-4068-a3e1-54571baa3a5c tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:16.164315 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.wsgi [None req-ab439e33-c3ba-4068-a3e1-54571baa3a5c tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] HTTP exception thrown: Instance 5e461f9e-4217-45ec-bf28-2a70f7ca0f82 could not be found. May 23 17:03:16.165807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ab439e33-c3ba-4068-a3e1-54571baa3a5c tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Request method failure captured: May 23 17:03:16.165807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: request: GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 HTTP/1.1 May 23 17:03:16.165807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept: application/json May 23 17:03:16.165807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Accept-Encoding: identity May 23 17:03:16.165807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Connection: close May 23 17:03:16.165807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Length: 0 May 23 17:03:16.165807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Content-Type: application/json May 23 17:03:16.165807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Host: 10.222.0.74 May 23 17:03:16.165807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Openstack-System-Scope: None May 23 17:03:16.165807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: User-Agent: python-urllib3/1.26.9 May 23 17:03:16.165807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Auth-Token: gAAAAABii7xBrV4MjFQh51j4dPvJWSwFpw9CUbC49y-llzMB8Abn5LWu0gl2XpNIPHXBBG8AW61v_eaHkKQumxXQe5ZAM2zmHFTjIw_fBD--b9MfK81l987usOgVabVAT5Uj5BFtUIWTwtdJGrJFRxvzrM5GVBHx1tt3O3LXuh_R-aV7OWRFItQ May 23 17:03:16.165807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Id: None May 23 17:03:16.165807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Domain-Name: None May 23 17:03:16.165807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Identity-Status: Confirmed May 23 17:03:16.165807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Is-Admin-Project: True May 23 17:03:16.165807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Id: default May 23 17:03:16.165807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Domain-Name: Default May 23 17:03:16.165807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Id: 8d09d9819e564152aacc661d1da68fcd May 23 17:03:16.165807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Project-Name: tempest-TestVolumeBootPattern-528381394 May 23 17:03:16.165807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Role: member,reader May 23 17:03:16.165807 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Roles: member,reader May 23 17:03:16.167546 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8d09d9819e564152aacc661d1da68fcd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8d09d9819e564152aacc661d1da68fcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8d09d9819e564152aacc661d1da68fcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8d09d9819e564152aacc661d1da68fcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 17:03:16.167546 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant: tempest-TestVolumeBootPattern-528381394 May 23 17:03:16.167546 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Id: 8d09d9819e564152aacc661d1da68fcd May 23 17:03:16.167546 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-Tenant-Name: tempest-TestVolumeBootPattern-528381394 May 23 17:03:16.167546 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User: tempest-TestVolumeBootPattern-528381394-project May 23 17:03:16.167546 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Id: default May 23 17:03:16.167546 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Domain-Name: Default May 23 17:03:16.167546 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Id: 2aa01ac54736475188dbc47f3cda4de1 May 23 17:03:16.167546 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: X-User-Name: tempest-TestVolumeBootPattern-528381394-project May 23 17:03:16.167546 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: method: > May 23 17:03:16.167546 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: exception: Instance 5e461f9e-4217-45ec-bf28-2a70f7ca0f82 could not be found. May 23 17:03:16.167546 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: action_args: {'id': '5e461f9e-4217-45ec-bf28-2a70f7ca0f82'} May 23 17:03:16.168557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:03:16.168557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:03:16.168557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:03:16.168557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:03:16.168557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:03:16.168557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:03:16.168557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:03:16.168557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:03:16.168557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:03:16.168557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:03:16.168557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e461f9e-4217-45ec-bf28-2a70f7ca0f82 could not be found. May 23 17:03:16.168557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 17:03:16.168557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:03:16.168557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 17:03:16.168557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:03:16.168557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:03:16.168557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:03:16.168557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:03:16.168557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:03:16.168557 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:03:16.170177 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:03:16.170177 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:03:16.170177 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:03:16.170177 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:03:16.170177 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:03:16.170177 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:03:16.170177 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:03:16.170177 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e461f9e-4217-45ec-bf28-2a70f7ca0f82 could not be found. May 23 17:03:16.170177 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 17:03:16.170177 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:03:16.170177 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 17:03:16.170177 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:03:16.170177 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:03:16.170177 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:03:16.170177 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:03:16.170177 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:03:16.170177 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e461f9e-4217-45ec-bf28-2a70f7ca0f82 could not be found. May 23 17:03:16.170177 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: ERROR nova.api.openstack.wsgi May 23 17:03:16.171994 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-ab439e33-c3ba-4068-a3e1-54571baa3a5c tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Returning 404 to user: Instance 5e461f9e-4217-45ec-bf28-2a70f7ca0f82 could not be found. {{(pid=124714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:03:16.171994 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-ab439e33-c3ba-4068-a3e1-54571baa3a5c tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82" status: 404 len: 111 microversion: 2.1 time: 0.030545 May 23 17:03:16.171994 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 571/1165] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:03:16 2022] GET /compute/v2.1/servers/5e461f9e-4217-45ec-bf28-2a70f7ca0f82 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:03:17.657163 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-8ae5e2b0-dad2-4ae0-82c3-e6178096b1a1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] Calling method '.version_select at 0x7f224c76fc10>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:03:17.750400 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-8ae5e2b0-dad2-4ae0-82c3-e6178096b1a1 tempest-TestVolumeBootPattern-528381394 tempest-TestVolumeBootPattern-528381394-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-877096425" status: 202 len: 0 microversion: 2.1 time: 0.097131 May 23 17:03:17.750994 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 595/1166] 10.222.0.74 () {58 vars in 1259 bytes} [Mon May 23 17:03:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-877096425 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:03:51.982748 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:03:51.984159 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Mon May 23 17:03:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:03:57.223742 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-391bb2d1-4f40-4065-b531-306d29f6b722 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:03:57.224337 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-391bb2d1-4f40-4065-b531-306d29f6b722 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:03:57.226618 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:57.227721 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:57.227865 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG dbcounter [-] [124715] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:57.228090 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG dbcounter [-] [124714] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:03:57.231393 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-390bfc27-d4c7-45a6-a256-2a7a5449571e req-c931dfa3-d116-413c-956c-39a63585dacd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "925b5356-8e06-47f5-830f-74661c6f997f", "tag": "c3614cfe-7148-48d7-8938-8ee190885e3e"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:03:57.233501 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-391bb2d1-4f40-4065-b531-306d29f6b722 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:57.234035 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-391bb2d1-4f40-4065-b531-306d29f6b722 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:57.234881 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-391bb2d1-4f40-4065-b531-306d29f6b722 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:57.235543 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-391bb2d1-4f40-4065-b531-306d29f6b722 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:57.240197 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-390bfc27-d4c7-45a6-a256-2a7a5449571e req-c931dfa3-d116-413c-956c-39a63585dacd service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:57.247095 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-390bfc27-d4c7-45a6-a256-2a7a5449571e req-c931dfa3-d116-413c-956c-39a63585dacd service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:57.251858 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-390bfc27-d4c7-45a6-a256-2a7a5449571e req-c931dfa3-d116-413c-956c-39a63585dacd service nova] Creating event network-changed:c3614cfe-7148-48d7-8938-8ee190885e3e for instance 925b5356-8e06-47f5-830f-74661c6f997f on hv-cinder-83925 May 23 17:03:57.257409 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-390bfc27-d4c7-45a6-a256-2a7a5449571e req-c931dfa3-d116-413c-956c-39a63585dacd service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031939 May 23 17:03:57.259612 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 596/1167] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 17:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:03:57.269078 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-391bb2d1-4f40-4065-b531-306d29f6b722 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Going to try to terminate instance {{(pid=124714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:03:57.573952 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-391bb2d1-4f40-4065-b531-306d29f6b722 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "DELETE /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 204 len: 0 microversion: 2.1 time: 0.354410 May 23 17:03:57.578023 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 572/1168] 10.222.0.74 () {58 vars in 1238 bytes} [Mon May 23 17:03:57 2022] DELETE /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 17:03:57.583815 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-0867aa63-3c5e-4d1e-ae4b-5e63ce1cb4d0 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:03:57.584657 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-0867aa63-3c5e-4d1e-ae4b-5e63ce1cb4d0 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:03:57.593034 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0867aa63-3c5e-4d1e-ae4b-5e63ce1cb4d0 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:57.593498 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0867aa63-3c5e-4d1e-ae4b-5e63ce1cb4d0 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:57.594471 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0867aa63-3c5e-4d1e-ae4b-5e63ce1cb4d0 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:57.595090 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-0867aa63-3c5e-4d1e-ae4b-5e63ce1cb4d0 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:57.748315 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.policy [None req-0867aa63-3c5e-4d1e-ae4b-5e63ce1cb4d0 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124715) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:03:57.757525 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-0867aa63-3c5e-4d1e-ae4b-5e63ce1cb4d0 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1568 microversion: 2.1 time: 0.177977 May 23 17:03:57.759133 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 597/1169] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:03:57 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:03:58.776927 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-844354f0-e11b-4276-a1e1-593b2127cf23 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:03:58.777629 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-844354f0-e11b-4276-a1e1-593b2127cf23 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:03:58.784439 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-844354f0-e11b-4276-a1e1-593b2127cf23 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:58.784893 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-844354f0-e11b-4276-a1e1-593b2127cf23 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:58.785661 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-844354f0-e11b-4276-a1e1-593b2127cf23 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:58.786103 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-844354f0-e11b-4276-a1e1-593b2127cf23 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:58.924174 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-844354f0-e11b-4276-a1e1-593b2127cf23 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:03:58.932189 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-844354f0-e11b-4276-a1e1-593b2127cf23 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1450 microversion: 2.1 time: 0.160675 May 23 17:03:58.932786 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 573/1170] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:03:58 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:03:59.003304 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:03:59.003479 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Mon May 23 17:03:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:03:59.780229 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [req-94789c5a-9a26-479f-b134-42c9a06e5cda req-749585ad-9714-41d7-8460-bc707b96a224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "925b5356-8e06-47f5-830f-74661c6f997f", "name": "network-vif-deleted", "tag": "c3614cfe-7148-48d7-8938-8ee190885e3e"}]} {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:03:59.788139 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-94789c5a-9a26-479f-b134-42c9a06e5cda req-749585ad-9714-41d7-8460-bc707b96a224 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:59.788619 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [req-94789c5a-9a26-479f-b134-42c9a06e5cda req-749585ad-9714-41d7-8460-bc707b96a224 service nova] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:59.799740 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.compute.server_external_events [req-94789c5a-9a26-479f-b134-42c9a06e5cda req-749585ad-9714-41d7-8460-bc707b96a224 service nova] Creating event network-vif-deleted:c3614cfe-7148-48d7-8938-8ee190885e3e for instance 925b5356-8e06-47f5-830f-74661c6f997f on hv-cinder-83925 May 23 17:03:59.805898 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [req-94789c5a-9a26-479f-b134-42c9a06e5cda req-749585ad-9714-41d7-8460-bc707b96a224 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145707 May 23 17:03:59.806033 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 598/1171] 10.222.0.74 () {64 vars in 1317 bytes} [Mon May 23 17:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:03:59.952279 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-08cf4041-ee4d-4ec0-9f28-98a47ce916c7 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:03:59.952943 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.compute.api [None req-08cf4041-ee4d-4ec0-9f28-98a47ce916c7 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124714) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:03:59.959617 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-08cf4041-ee4d-4ec0-9f28-98a47ce916c7 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:59.960802 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-08cf4041-ee4d-4ec0-9f28-98a47ce916c7 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:03:59.961665 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-08cf4041-ee4d-4ec0-9f28-98a47ce916c7 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:03:59.962793 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG oslo_concurrency.lockutils [None req-08cf4041-ee4d-4ec0-9f28-98a47ce916c7 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:04:00.031409 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.policy [None req-08cf4041-ee4d-4ec0-9f28-98a47ce916c7 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e80a38a048456ba61ce41648475374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae6212e50a1473a91e3abcff84f6f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124714) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:04:00.039778 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-08cf4041-ee4d-4ec0-9f28-98a47ce916c7 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 200 len: 1218 microversion: 2.1 time: 0.092044 May 23 17:04:00.040590 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 574/1172] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:03:59 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:04:01.058715 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7267d64f-1036-4619-bbcd-793c16842166 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '>' {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:04:01.059427 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.compute.api [None req-7267d64f-1036-4619-bbcd-793c16842166 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] [instance: 925b5356-8e06-47f5-830f-74661c6f997f] Fetching instance by UUID {{(pid=124715) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:04:01.065731 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7267d64f-1036-4619-bbcd-793c16842166 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:04:01.066184 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7267d64f-1036-4619-bbcd-793c16842166 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:04:01.066952 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7267d64f-1036-4619-bbcd-793c16842166 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:04:01.067395 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG oslo_concurrency.lockutils [None req-7267d64f-1036-4619-bbcd-793c16842166 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Lock "3da232e7-0be9-4eeb-8f07-26e17f9287c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:04:01.084060 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.wsgi [None req-7267d64f-1036-4619-bbcd-793c16842166 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] HTTP exception thrown: Instance 925b5356-8e06-47f5-830f-74661c6f997f could not be found. May 23 17:04:01.085752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7267d64f-1036-4619-bbcd-793c16842166 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Request method failure captured: May 23 17:04:01.085752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: request: GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f HTTP/1.1 May 23 17:04:01.085752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept: application/json May 23 17:04:01.085752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Accept-Encoding: identity May 23 17:04:01.085752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Connection: close May 23 17:04:01.085752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Length: 0 May 23 17:04:01.085752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Content-Type: application/json May 23 17:04:01.085752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Host: 10.222.0.74 May 23 17:04:01.085752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Openstack-System-Scope: None May 23 17:04:01.085752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: User-Agent: python-urllib3/1.26.9 May 23 17:04:01.085752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Auth-Token: gAAAAABii70XW_E4-6AzWsUY8PtjD7Uuz2nq61LzeG5uh4F4a9va5OVO9qbyVYZ3mU84eSA37kjcdgz2XNeXYvFINq7fUmTZWqrqs0gQCMcCmDtBZsxzDzhheQYV2bktJI-6WDVruW-VUqeiIZWQJUf_tkvToikz_Wi-PyY5ZtabJaGQDOkc7VQ May 23 17:04:01.085752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Id: None May 23 17:04:01.085752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Domain-Name: None May 23 17:04:01.085752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Identity-Status: Confirmed May 23 17:04:01.085752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Is-Admin-Project: True May 23 17:04:01.085752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Id: default May 23 17:04:01.085752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Domain-Name: Default May 23 17:04:01.085752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Id: 6ae6212e50a1473a91e3abcff84f6f9b May 23 17:04:01.085752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Project-Name: tempest-TestShelveInstance-1020298109 May 23 17:04:01.085752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Role: member,reader May 23 17:04:01.085752 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Roles: member,reader May 23 17:04:01.087711 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/6ae6212e50a1473a91e3abcff84f6f9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/6ae6212e50a1473a91e3abcff84f6f9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/6ae6212e50a1473a91e3abcff84f6f9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_6ae6212e50a1473a91e3abcff84f6f9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] May 23 17:04:01.087711 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant: tempest-TestShelveInstance-1020298109 May 23 17:04:01.087711 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Id: 6ae6212e50a1473a91e3abcff84f6f9b May 23 17:04:01.087711 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-Tenant-Name: tempest-TestShelveInstance-1020298109 May 23 17:04:01.087711 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User: tempest-TestShelveInstance-1020298109-project May 23 17:04:01.087711 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Id: default May 23 17:04:01.087711 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Domain-Name: Default May 23 17:04:01.087711 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Id: 43e80a38a048456ba61ce41648475374 May 23 17:04:01.087711 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: X-User-Name: tempest-TestShelveInstance-1020298109-project May 23 17:04:01.087711 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: method: > May 23 17:04:01.087711 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: exception: Instance 925b5356-8e06-47f5-830f-74661c6f997f could not be found. May 23 17:04:01.087711 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: action_args: {'id': '925b5356-8e06-47f5-830f-74661c6f997f'} May 23 17:04:01.088969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: {{(pid=124715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:04:01.088969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:04:01.088969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:04:01.088969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:04:01.088969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:04:01.088969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:04:01.088969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:04:01.088969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:04:01.088969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:04:01.088969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:04:01.088969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 925b5356-8e06-47f5-830f-74661c6f997f could not be found. May 23 17:04:01.088969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 17:04:01.088969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:04:01.088969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 17:04:01.088969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:04:01.088969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:04:01.088969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:04:01.088969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:04:01.088969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:04:01.088969 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:04:01.090817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:04:01.090817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:04:01.090817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:04:01.090817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:04:01.090817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:04:01.090817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:04:01.090817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:04:01.090817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 925b5356-8e06-47f5-830f-74661c6f997f could not be found. May 23 17:04:01.090817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 17:04:01.090817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:04:01.090817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 17:04:01.090817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:04:01.090817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:04:01.090817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:04:01.090817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:04:01.090817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:04:01.090817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 925b5356-8e06-47f5-830f-74661c6f997f could not be found. May 23 17:04:01.090817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: ERROR nova.api.openstack.wsgi May 23 17:04:01.092473 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: DEBUG nova.api.openstack.wsgi [None req-7267d64f-1036-4619-bbcd-793c16842166 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Returning 404 to user: Instance 925b5356-8e06-47f5-830f-74661c6f997f could not be found. {{(pid=124715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:04:01.092473 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO nova.api.openstack.requestlog [None req-7267d64f-1036-4619-bbcd-793c16842166 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f" status: 404 len: 111 microversion: 2.1 time: 0.034423 May 23 17:04:01.092473 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: [pid: 124715|app: 0|req: 599/1173] 10.222.0.74 () {58 vars in 1235 bytes} [Mon May 23 17:04:01 2022] GET /compute/v2.1/servers/925b5356-8e06-47f5-830f-74661c6f997f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:04:01.326308 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: DEBUG nova.api.openstack.wsgi [None req-6d9cdc90-5f95-4729-8bf4-8180a2c19849 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] Calling method '.version_select at 0x7f224c2e7310>' {{(pid=124714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:04:01.407867 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO nova.api.openstack.requestlog [None req-6d9cdc90-5f95-4729-8bf4-8180a2c19849 tempest-TestShelveInstance-1020298109 tempest-TestShelveInstance-1020298109-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-312995941" status: 202 len: 0 microversion: 2.1 time: 0.086340 May 23 17:04:01.408407 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: [pid: 124714|app: 0|req: 575/1174] 10.222.0.74 () {58 vars in 1250 bytes} [Mon May 23 17:04:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-312995941 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:04:07.917383 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:04:07.918080 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Mon May 23 17:04:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:05:46.569403 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:05:46.570020 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Mon May 23 17:05:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:06:03.833022 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:06:03.833620 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Mon May 23 17:06:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:07:11.990985 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:07:11.991602 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Mon May 23 17:07:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:07:19.012131 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:07:19.012773 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Mon May 23 17:07:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:07:27.926489 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:07:27.927173 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Mon May 23 17:07:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:09:06.577277 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:09:06.577817 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Mon May 23 17:09:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:09:16.173289 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:09:16.173986 dv-cinder-839257-3-iscsi devstack@n-api.service[124715]: Mon May 23 17:09:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:09:23.841432 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:09:23.842067 dv-cinder-839257-3-iscsi devstack@n-api.service[124714]: Mon May 23 17:09:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!